-- Logs begin at Sun 2022-08-07 23:33:38 UTC, end at Mon 2022-08-08 00:51:13 UTC. -- Aug 08 00:23:45.429388 dv-cinder-851640-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 00:23:45.438170 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 00:23:45 2022] *** Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: nodename: dv-cinder-851640-3-iscsi Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: machine: x86_64 Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: clock source: unix Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: pcre jit disabled Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: detected number of CPU cores: 4 Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: current working directory: / Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: detected binary path: /usr/bin/uwsgi-core Aug 08 00:23:45.440190 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: your processes number limit is 47680 Aug 08 00:23:45.440976 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: your memory page size is 4096 bytes Aug 08 00:23:45.440976 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: detected max file descriptor number: 2048 Aug 08 00:23:45.440976 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: lock engine: pthread robust mutexes Aug 08 00:23:45.440976 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: thunder lock: enabled Aug 08 00:23:45.440976 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 00:23:45.440976 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 00:23:45.479645 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: Python main interpreter initialized at 0x5578a22019c0 Aug 08 00:23:45.479645 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: python threads support enabled Aug 08 00:23:45.479645 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: your server socket listen backlog is limited to 100 connections Aug 08 00:23:45.479645 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: your mercy for graceful operations on workers is 90 seconds Aug 08 00:23:45.479999 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 00:23:45.480076 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: *** Operational MODE: preforking *** Aug 08 00:23:45.480316 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: *** uWSGI is running in multiple interpreter mode *** Aug 08 00:23:45.480316 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: spawned uWSGI master process (pid: 115203) Aug 08 00:23:45.480535 dv-cinder-851640-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 00:23:45.483278 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: spawned uWSGI worker 1 (pid: 115204, cores: 1) Aug 08 00:23:45.483278 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: spawned uWSGI worker 2 (pid: 115205, cores: 1) Aug 08 00:23:45.483278 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 00:23:46.137509 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 00:23:46.147336 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 00:23:47.212537 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:23:47.212537 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: from cryptography.utils import int_from_bytes Aug 08 00:23:47.213131 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:23:47.213131 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: from cryptography.utils import int_from_bytes Aug 08 00:23:47.215460 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:23:47.215460 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: from cryptography.utils import int_from_bytes Aug 08 00:23:47.215910 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:23:47.215910 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: from cryptography.utils import int_from_bytes Aug 08 00:23:49.720435 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 00:23:49.721030 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 00:23:49.721214 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 00:23:49.721582 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 00:23:49.721834 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 00:23:49.722254 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.722616 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.722935 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.723160 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 00:23:49.723563 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.723655 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 00:23:49.723740 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.723878 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.723977 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 00:23:49.724192 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.724300 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 00:23:49.724504 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.724601 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 00:23:49.724832 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.724941 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.725084 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.725182 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.725392 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.725485 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.725710 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-3-iscsi {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.725814 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.726023 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.726116 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.726321 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.726421 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.726624 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.726718 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.726937 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.727030 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.727260 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.727361 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.727569 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.727664 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.727869 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.727963 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.728184 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-3-iscsi {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.728352 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.728501 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.728781 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.728916 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.729081 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.729183 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.729384 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.729488 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.729682 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.729791 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.729995 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.730105 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.730295 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.730396 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.730605 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.730792 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.730899 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.731095 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.731214 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.731422 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.731539 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.731727 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.731927 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-3-iscsi {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.732054 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.732238 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.732359 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.732546 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.732645 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.732855 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.732962 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.733260 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.733356 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.733567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.733717 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.733869 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.733951 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.734181 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.734275 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-3-iscsi {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.734508 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.734611 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.734821 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.734927 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.735130 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.735270 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.735466 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.735564 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.735781 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.735879 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.736095 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.736181 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.736394 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.736481 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.736699 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.736793 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.737004 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.737097 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.737317 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.737420 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.737620 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.737712 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.738467 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.738560 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.738781 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.738910 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.739091 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.739212 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.739437 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.739526 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.739755 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.739854 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.740074 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.740170 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.740323 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.740416 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.740568 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.740704 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.740881 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.740976 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.741199 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.741294 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.741503 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.741590 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.741807 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.741900 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.742110 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.742208 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.742356 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.742449 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.742603 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.742701 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.742918 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.743096 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.743248 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.743339 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.743556 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.743642 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.743857 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.743952 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.744158 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.744250 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.744460 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.744553 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.744761 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.744855 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.745062 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.745220 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.745363 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.745457 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.745662 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.745749 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.745972 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.746073 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.746280 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.746366 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.746595 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.746688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.746897 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.746989 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.747211 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.747334 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.747549 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.747637 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.747852 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.747936 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.748150 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.748245 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.748453 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.748550 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.748771 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.748866 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.749072 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.749170 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.749385 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.749478 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.749633 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.749727 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.749933 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.750041 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.750234 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.750321 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.750546 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.750637 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.750849 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.750952 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.751151 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.751277 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.751475 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.751570 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.751728 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.751821 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.752023 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.752115 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.752321 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.752418 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.752635 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.752721 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.752933 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.753019 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.753233 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.753325 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.753609 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.754198 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.754398 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.754496 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.754699 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.754791 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.754990 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.755079 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.755329 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.755434 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.755650 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.755746 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.755961 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.756068 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.756251 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.756349 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.756548 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.756643 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.756845 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.756930 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.757143 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.757229 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.757445 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.757539 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.757748 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.757846 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.758045 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.758138 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.758344 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.758444 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.758643 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.758729 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.758938 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.759030 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.759268 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.759371 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.759563 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.759648 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.759863 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.759956 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.760157 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.760261 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.760460 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.760554 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.760756 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.760851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.761059 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.761155 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.761359 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.761446 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.761655 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.761740 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.761951 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.762044 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.762249 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.762334 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.762546 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.762638 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.762845 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.762946 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.763143 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.763251 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.763460 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.763546 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.763755 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.763840 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.764051 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.764138 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.764350 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.764437 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.764648 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.764742 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.764945 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.765032 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.765243 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.765335 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.765536 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.765633 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.765847 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.765937 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.766146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.766250 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.766448 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.766543 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.766749 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.766851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.767046 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.767145 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.768347 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:23:49.768444 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.768543 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.768632 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.768711 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.768808 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.768808 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.768808 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.769020 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.769261 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.769402 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.769615 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.769729 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.769945 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.770080 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.770273 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.770438 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.770593 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.770686 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.770904 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.770992 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.771216 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.771358 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.771564 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.771672 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.771876 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.771963 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.772188 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.772287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.772499 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.772586 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.772806 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.772900 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.773120 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.773213 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.773494 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.773624 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.773758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.773846 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.774070 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.774197 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.774385 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.774474 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.774692 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.774818 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.775008 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.775110 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.775355 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.775446 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.775675 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.775777 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.775982 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.776074 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.776319 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.776422 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.776656 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.776802 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.776965 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.777069 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.777282 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.777375 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.777588 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.777672 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.777892 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.777979 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.778197 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.778282 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.778500 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.778586 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.778816 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.778904 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.779126 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.779212 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.779462 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.779561 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.779772 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.779857 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.780079 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.780164 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.780383 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.780482 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.780688 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.780774 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.780985 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.781073 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.781286 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.781389 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.781585 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.781674 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.781890 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.781976 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.782192 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.782292 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.782496 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.782581 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.782805 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.782893 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.783107 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.783193 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.783436 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.783523 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.783741 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.783835 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.784038 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.784126 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.784336 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.784423 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.784634 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.784887 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.785026 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.785191 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.785327 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.785511 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.785641 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.785820 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.785961 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.786124 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.786259 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.786444 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.786584 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.786751 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.786883 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.787056 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.787188 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.787399 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.787517 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.787717 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.787820 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.788032 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.788131 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.788317 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.788404 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.788624 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.788720 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.788933 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.789027 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.789240 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.789328 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.789549 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.789639 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.789851 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.789937 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.790162 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.790258 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.790459 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.790556 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.790758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.790853 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.791074 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.791281 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.791419 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.791557 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.791703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.791839 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.791972 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.792125 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.792266 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.792400 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.792582 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.792723 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.792889 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.793101 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.793237 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.793369 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.793501 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.793634 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.793777 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.793922 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.794063 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.794148 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.794336 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.794423 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.794639 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.794727 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.794940 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.795026 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.795254 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.795345 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.795562 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.795651 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.795880 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.795966 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.796177 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.796262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.796474 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.796560 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.796774 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.796862 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.797067 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.797166 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.797368 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.797455 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.797666 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.797751 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.797962 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.798059 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.798258 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.798353 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.798571 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.798658 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.798873 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.798969 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.799168 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.799269 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.799494 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.799631 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.799786 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.799930 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.800111 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.800255 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.800923 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.801011 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.801235 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.801395 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.801552 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.801685 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.801862 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.801995 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.802181 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.802325 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.802488 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.802620 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.802806 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.802947 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.803096 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.803283 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.803439 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.803576 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.803741 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.803878 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.804050 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.804207 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.804350 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.804495 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.804656 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.804802 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.804970 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.805068 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.805276 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.805409 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.805585 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.805729 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.805888 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.806022 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.806196 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.806332 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.806496 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.806643 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.806786 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.806918 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.807093 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.807247 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.807431 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.807576 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.807739 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.807877 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.808053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.808197 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.808340 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.808485 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.808659 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.808790 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.808961 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.809096 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.809268 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.809416 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.809553 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.809691 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.809860 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.809997 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.810169 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.810311 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.810457 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.810589 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.810771 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.810902 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.811074 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.811209 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.811411 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.811561 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.811713 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.811843 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.812016 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.812168 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.812302 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.812441 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.812609 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.812751 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.812897 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.813030 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.813199 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.813342 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.813507 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.813652 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.813794 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.813946 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.814100 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.814235 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.814398 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.814542 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.814684 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.814824 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.814990 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.815132 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.815308 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.815410 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.815607 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.815702 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.815911 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.816027 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.816781 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.816878 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.817086 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.817171 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.817391 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.817479 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.817691 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.817797 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.817989 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.818075 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.818289 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.818382 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.818587 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.818682 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.818884 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.818983 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.819181 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.819317 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.819503 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.819599 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.819804 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.819891 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.820115 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.820239 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.820429 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.820557 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.820722 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.820815 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.821018 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.821115 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.821331 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.821423 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.821632 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.821978 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.822195 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.822354 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.822498 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.822585 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.822795 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.822881 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.823111 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.823211 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.823443 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.823546 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.823740 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.823826 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.824045 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.824142 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.824352 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.824440 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.824653 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.824737 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.824955 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.825049 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.825255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.825340 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.825557 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.825644 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.825865 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.825951 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.826168 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.826253 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.826464 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.826550 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.826765 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.826865 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.827067 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.827154 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.827395 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.827650 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.827755 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.827980 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.828067 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.828288 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.828374 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.828592 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.828679 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.828893 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.828986 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.829187 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.829274 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.829489 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.829577 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.829797 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.829883 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.830151 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.830349 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.830446 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.830676 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.830771 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.830985 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.831073 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.831330 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.831432 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.831667 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.831804 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.831973 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.832068 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.832278 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.832375 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.832582 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.832670 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.832890 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.832978 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.833191 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.833288 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.833492 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.833592 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.833793 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.833914 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.834089 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.834189 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.834393 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.834492 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.834691 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.834867 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.835001 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.835137 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.835307 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.835454 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.835587 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.835723 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.835858 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.835992 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.836133 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.836268 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.836433 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.836576 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.836719 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.836854 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.837025 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.837162 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.837304 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.837440 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.837611 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.837749 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.837894 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.838027 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.838205 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.838342 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.838506 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.838650 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.838785 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.838918 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.839080 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.839216 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.839410 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.839561 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.839743 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.839873 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.840039 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.840184 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.840324 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.840469 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.840627 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.840776 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.840918 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.841054 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.841212 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.841357 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.841516 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.841659 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.841818 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.841950 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.842103 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.842245 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.842386 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.842527 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.842690 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.842825 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.842988 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.843120 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.843297 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.843445 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.843587 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.843720 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.843867 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.844016 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.844153 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.844293 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.844451 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.844587 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.844751 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.844892 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.845035 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.845170 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.845329 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.845547 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.845683 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.845828 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.845971 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.846112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.846246 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.846388 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.846522 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.846655 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.846788 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.846921 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.847055 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.847248 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.847436 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.847568 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.847724 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.847864 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.848008 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.848151 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.848288 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.848428 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.848596 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.848732 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.848881 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.849014 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.849174 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.849326 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.849463 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.849610 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.849745 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.849842 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.850046 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.850133 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.850386 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.850525 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.850655 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.850777 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.850991 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.851113 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.851310 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.851433 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.851574 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.851701 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.851875 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.852006 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.852171 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.852318 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.852473 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.852559 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.852775 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.852864 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.853073 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.853167 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.853375 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.853495 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.853669 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.853781 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.853963 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.854071 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.854260 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.854355 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.854559 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.854664 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.854854 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.854959 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.855152 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.855280 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.855472 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.855583 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.855772 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.855873 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.856069 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.856156 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.856365 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.856452 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.856663 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.856751 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.856977 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.857065 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.857276 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.857369 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.857572 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.857675 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.857869 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.857957 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.858163 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.858251 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.858470 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.858556 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.858776 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.858863 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.859080 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.859174 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.859409 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.859498 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.859708 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.859798 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.860006 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.860102 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.860319 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.860407 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.860620 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.860713 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.860924 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.861017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.861220 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.861313 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.861527 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.861614 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.861829 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.861931 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.862129 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.862265 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.862425 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.862559 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.862722 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.863473 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.863577 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.863659 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.863987 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.864075 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.864293 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.864380 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.864602 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.864689 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.864911 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.864998 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.865219 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.865316 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.865514 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.865599 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.865822 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.865991 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.866154 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.866294 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.866441 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.866578 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.866714 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.866850 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.866995 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.867130 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.867292 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.867425 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.867580 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.867728 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.867864 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.868000 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.868168 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.868308 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.868472 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.868619 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.868755 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.868890 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.869060 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.869197 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.869360 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.869514 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.869651 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.869786 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.869963 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.870095 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.870266 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.870417 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.870559 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.870693 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.870834 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.870924 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.871117 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.871311 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.871448 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.871584 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.871719 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.871841 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.872130 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.872265 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.872434 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.872572 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.872735 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.872879 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.873028 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.873163 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.873329 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.873467 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.873633 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.873770 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.873984 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.874120 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.874264 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.874398 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.874532 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.874674 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.874815 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.874951 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.875092 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.875260 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.875395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.875540 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.875683 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.875819 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.876005 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.876139 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.876371 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.876516 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.876660 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.876801 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.876976 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.877113 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.877264 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.877408 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.877552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.877688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.877822 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.877956 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.878135 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.878279 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.878416 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.879210 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.879448 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.879592 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.879856 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.879994 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.880164 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.880299 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.880465 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.880602 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.880785 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.880929 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.881108 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.881242 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.881421 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.881568 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.881735 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.881883 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.882041 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.882177 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.882347 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.882439 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.882651 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.882746 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.882961 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.883050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.883293 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.883386 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.883617 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.883716 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.883936 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.884033 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.884244 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.884333 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.884555 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.884722 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.884854 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.884943 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.885170 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.885267 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.885484 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.885587 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.885788 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.885875 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.886096 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.886185 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.886397 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.886495 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.886714 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.886811 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.887012 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.887109 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.887344 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.887449 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.887652 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.887742 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.887956 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.888044 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.888256 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.888346 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.888557 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.888652 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.888874 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.888962 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.889172 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.889268 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.889487 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.889575 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.889785 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.889873 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.890091 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.890181 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.890395 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.890491 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.890693 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.890790 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.890988 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.891084 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.891307 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.891402 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.891608 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.891706 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.891908 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.891997 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.892208 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.892307 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.892512 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.892620 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.892827 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.892916 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.893139 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.893226 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.893434 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.893534 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.893750 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.893847 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.894053 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.894141 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.894376 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.894556 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.894710 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.894809 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.894950 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.895041 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.895310 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.895429 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.895613 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.895714 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.895926 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.896023 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.896221 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.896327 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.896526 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.896631 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.896828 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.896932 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.897127 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.897224 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.897424 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.897530 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.897726 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.897839 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.898022 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.898127 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.898320 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.898416 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.898618 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.898723 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.898915 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.899010 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.899214 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.899324 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.899534 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.899643 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.899830 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.899928 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.900126 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.900220 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.900424 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.900528 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.900718 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.900814 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.901014 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.901120 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.901310 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.901447 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.901623 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.901713 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.901919 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.902007 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.902232 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.902335 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.902531 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.902631 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.902828 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.902918 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.903130 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.903219 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.903450 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.903538 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.903756 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.903853 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.904067 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.904157 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.904376 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.904465 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.904676 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.904773 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.904985 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.905080 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.905290 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.905384 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.905597 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.905693 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.905905 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.906112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.906201 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.906436 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.906527 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.906745 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.906836 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.907054 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.907143 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.907384 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.907491 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.907696 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.907823 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.908002 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.908092 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.908304 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.908415 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.908608 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.908814 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.908908 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.909132 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.909225 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.909441 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.909552 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.910341 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.910444 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.910664 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.910820 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.911012 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.911111 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.911346 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.911441 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.911661 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.911788 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.911966 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.912054 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.912272 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.912376 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.912575 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.912677 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.912898 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.912991 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.913204 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.913296 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.913512 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.913618 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.913822 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.913910 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.914129 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.914218 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.914435 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.914524 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.914739 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.914826 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.915044 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.915130 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.915371 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.915461 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.915677 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.915766 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.915984 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.916090 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.916297 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.916427 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.916602 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.916689 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.916908 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.917005 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.917216 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.917305 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.917522 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.917610 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.917828 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.917935 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.918127 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.918222 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.918431 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.918519 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.918737 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.918940 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.919044 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.919271 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.919393 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.919591 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.919691 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.919909 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.920056 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.920228 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.920369 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.920538 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.920641 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.920850 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.920950 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.921172 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.921271 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.921470 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.921683 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.921786 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.921992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.922082 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.922318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.922435 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.922625 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.922770 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.922938 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.923027 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.923262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.923367 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.923556 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.923655 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.923868 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.923957 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.924165 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.924263 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.924464 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.924687 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.924777 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.925030 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.925128 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.925397 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.926011 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.926285 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.926385 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.926611 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.926714 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.926910 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.926999 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.927216 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.927324 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.927553 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.927651 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.927853 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.928076 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.928164 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.928411 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.928507 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.928721 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.928809 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.929028 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.929123 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.929328 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.929427 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.929631 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.929720 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.929930 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.930017 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.930225 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.930321 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.930529 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.930619 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.930825 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.930911 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.931134 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.931348 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.931457 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.931545 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.931752 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.931859 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.932046 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.932143 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.932347 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.932434 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.932641 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.932736 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.932937 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.933028 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.933233 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.933322 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.933531 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.933621 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.933833 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.933944 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.934131 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.934223 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.934429 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.934524 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.934738 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.934832 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.935025 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.935121 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.935345 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.935449 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.935640 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.935727 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.935936 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.936035 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.936230 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.936327 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.936535 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.936669 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.936830 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.936918 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.937133 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.937234 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.937428 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.937517 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.937769 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.937918 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.938053 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.938204 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.938339 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.938478 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.938612 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.938749 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.938894 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.939046 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.939186 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.939500 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.939636 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.939818 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.939968 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.940103 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.940238 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.940424 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.940559 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.940728 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.940875 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.941051 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.941231 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.941409 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.941548 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.941693 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.941852 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.941999 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.942180 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.942320 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.942508 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.942722 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.942810 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.942949 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.943114 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.943203 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.943441 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.943544 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.943748 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.943837 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.944048 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.944135 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.944348 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.944447 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.944652 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.944741 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.944956 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.945052 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.945258 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.945355 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.945559 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.945648 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.945863 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.945950 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.946169 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.946259 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.946474 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.946565 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.947046 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.947140 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.947377 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.947482 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.947684 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.947773 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.947988 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.948077 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.948293 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.948385 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.948594 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.948682 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.948896 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.948993 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.949195 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.949283 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.949499 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.949587 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.949829 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.949933 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.950141 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.950229 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.950450 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.950539 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.950751 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.950848 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.951058 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.951153 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.951385 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.951476 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.951689 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.951778 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.951991 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.952089 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.952290 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.952387 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.952598 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.952726 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.952917 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.953008 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.953226 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.953314 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.953524 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.953613 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.953848 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.953943 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.954169 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.954299 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.954499 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.954606 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.954816 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.954911 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.955119 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.955217 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.955444 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.955532 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.955745 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.955833 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.956049 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.956157 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.956354 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.956443 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.958579 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.960691 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.960801 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.960886 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.960966 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961054 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961135 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961215 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961303 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961392 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961475 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961555 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961634 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961715 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961808 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961890 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.961978 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962049 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962128 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962215 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962305 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962387 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962467 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962547 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962627 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962715 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962850 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.962935 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963014 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963094 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963174 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963281 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963372 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963454 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963533 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963612 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963691 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963780 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963861 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.963947 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964027 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964113 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964194 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964281 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964369 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964450 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964537 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964619 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964707 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964788 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964867 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.964946 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965025 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965104 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965191 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965272 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965351 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965438 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965524 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965605 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965697 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965778 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965858 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.965950 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.966032 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.966111 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.966363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.966454 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.966670 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.966762 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.966979 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.967081 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.967307 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.967412 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.967614 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.967701 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.967917 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.968053 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.968223 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.968312 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.968530 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.968625 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.968834 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.968933 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.969138 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.969225 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.969452 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.969539 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.969758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.969855 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.970064 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.970152 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.970368 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.970456 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.970672 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.970764 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.970978 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.971066 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.971315 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.971423 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.971624 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.971715 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.971922 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.972009 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.972761 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.972933 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.973091 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.973235 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.973416 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.973582 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.973733 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.973896 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.974040 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.974207 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.974365 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.974523 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.974669 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.974838 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.974974 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.975163 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.975303 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.975509 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.975617 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.975819 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.975922 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.976144 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.976233 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.976466 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.976564 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.976785 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.976873 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.977097 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.977186 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.977407 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.977504 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.977729 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.977818 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.978045 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.978183 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.978348 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.978453 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.978646 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.978742 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.978886 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 00:23:49.978983 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.979325 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.979635 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.979974 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.980298 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.980608 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.980913 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.981214 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:23:49.981453 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 00:23:50.131993 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO dbcounter [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Registered counter for database nova_api Aug 08 00:23:50.134686 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO dbcounter [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Registered counter for database nova_api Aug 08 00:23:50.153554 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_db.sqlalchemy.engines [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:23:50.155075 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_db.sqlalchemy.engines [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:23:50.160801 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writer thread running {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:23:50.162094 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writer thread running {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:23:50.217435 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.context [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcec479f-7399-421c-8451-79722ed0a20d(cell1) {{(pid=115204) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 00:23:50.218776 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.context [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcec479f-7399-421c-8451-79722ed0a20d(cell1) {{(pid=115205) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 00:23:50.221194 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:23:50.221669 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:23:50.222692 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_concurrency.lockutils [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:23:50.223263 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_concurrency.lockutils [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:23:50.223387 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:23:50.224115 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:23:50.224560 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:23:50.224788 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_concurrency.lockutils [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:23:50.225510 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_concurrency.lockutils [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:23:50.225951 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_concurrency.lockutils [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:23:50.226516 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:23:50.227937 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_concurrency.lockutils [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:23:50.228481 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO dbcounter [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Registered counter for database nova_cell0 Aug 08 00:23:50.229892 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO dbcounter [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Registered counter for database nova_cell0 Aug 08 00:23:50.234006 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO dbcounter [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Registered counter for database nova_cell1 Aug 08 00:23:50.235186 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO dbcounter [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Registered counter for database nova_cell1 Aug 08 00:23:50.241353 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_db.sqlalchemy.engines [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:23:50.242992 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_db.sqlalchemy.engines [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:23:50.244631 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_db.sqlalchemy.engines [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:23:50.247124 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_db.sqlalchemy.engines [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:23:50.247415 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writer thread running {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:23:50.251255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writer thread running {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:23:50.387649 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writer thread running {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:23:50.388194 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writer thread running {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:23:50.396359 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO dbcounter [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Registered counter for database nova_cell0 Aug 08 00:23:50.398030 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO dbcounter [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Registered counter for database nova_cell0 Aug 08 00:23:50.405220 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_db.sqlalchemy.engines [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:23:50.406751 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG oslo_db.sqlalchemy.engines [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:23:50.409569 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writer thread running {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:23:50.411606 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writer thread running {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:23:50.821434 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: WARNING keystonemiddleware.auth_token [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 00:23:50.828969 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: WARNING keystonemiddleware.auth_token [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 00:23:50.851075 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: WARNING keystonemiddleware.auth_token [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 00:23:50.858331 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: WARNING keystonemiddleware.auth_token [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 00:23:51.168766 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: WARNING keystonemiddleware.auth_token [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 00:23:51.174751 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: WARNING keystonemiddleware.auth_token [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 00:23:51.180048 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578a22019c0 pid: 115204 (default app) Aug 08 00:23:51.182102 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:23:51.183290 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001707 Aug 08 00:23:51.183697 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Mon Aug 8 00:23:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:23:51.204530 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: WARNING keystonemiddleware.auth_token [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 00:23:51.211502 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: WARNING keystonemiddleware.auth_token [None req-11f67c00-20de-4794-94f2-c3b91e5821ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 00:23:51.216746 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5578a22019c0 pid: 115205 (default app) Aug 08 00:25:10.348735 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:10.351010 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002733 Aug 08 00:25:10.351801 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:10.364017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writing DB stats nova_api:SELECT=3 {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:10.365167 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writing DB stats nova_cell1:SELECT=3 {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:10.366186 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writing DB stats nova_cell0:SELECT=3 {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:10.367238 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:11.241710 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-d540ff8e-670b-4810-8d0b-79f35773e4c0 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:11.276341 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-d540ff8e-670b-4810-8d0b-79f35773e4c0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917427 Aug 08 00:25:11.277209 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 8 00:25:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:25:13.477249 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:13.478247 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-8506f1ad-17e0-4b75-8199-a50679003772 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Aug 08 00:25:13.478626 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:14.050609 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-7588e01d-1263-45dd-9344-2936176de82b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "vcpus": 1, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:14.071610 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:25:14.071610 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: warnings.warn(msg) Aug 08 00:25:14.237912 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-7588e01d-1263-45dd-9344-2936176de82b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.752105 Aug 08 00:25:14.245982 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:25:14.252777 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_api:SELECT=3 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:14.253872 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_cell1:SELECT=3 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:14.254949 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_cell0:SELECT=3 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:14.256005 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:14.466021 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-2636f132-2e35-4d5d-b6f3-263556008298 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:14.470941 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:25:14.470941 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: warnings.warn(msg) Aug 08 00:25:14.589223 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-2636f132-2e35-4d5d-b6f3-263556008298 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.341983 Aug 08 00:25:14.590056 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 00:25:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:25:16.795144 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-7588e01d-1263-45dd-9344-2936176de82b admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:16.796185 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-7588e01d-1263-45dd-9344-2936176de82b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 08 00:25:16.796877 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:17.440455 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-09af9816-efeb-4700-aac2-1235365ab3ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:17.459479 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:25:17.459479 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: warnings.warn(msg) Aug 08 00:25:17.564870 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-09af9816-efeb-4700-aac2-1235365ab3ef admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.761472 Aug 08 00:25:17.572435 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:25:17.578392 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-cb7fe15b-8451-4bf9-be00-859031bf1c84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:17.582227 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:25:17.582227 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: warnings.warn(msg) Aug 08 00:25:17.677747 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-cb7fe15b-8451-4bf9-be00-859031bf1c84 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103099 Aug 08 00:25:17.680314 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 00:25:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:25:19.876533 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-09af9816-efeb-4700-aac2-1235365ab3ef admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:19.877597 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-09af9816-efeb-4700-aac2-1235365ab3ef admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Aug 08 00:25:19.877993 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:20.273928 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-763a5345-9d58-4ff7-82f0-179a55f4a840 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:20.369191 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-763a5345-9d58-4ff7-82f0-179a55f4a840 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485013 Aug 08 00:25:20.369849 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:25:20.381882 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-8aafe3d1-500c-4e7e-bcc1-76e26ea67eb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:20.504508 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-8aafe3d1-500c-4e7e-bcc1-76e26ea67eb3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126281 Aug 08 00:25:20.548745 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 00:25:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:25:22.734368 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-763a5345-9d58-4ff7-82f0-179a55f4a840 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:22.735922 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-763a5345-9d58-4ff7-82f0-179a55f4a840 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 08 00:25:22.736424 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:23.182903 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-6fe3066e-a0ea-4c89-bf3f-d46eefe97b2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:23.273481 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-6fe3066e-a0ea-4c89-bf3f-d46eefe97b2b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531179 Aug 08 00:25:23.274396 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:25:23.286527 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-589b5510-1aa9-4a57-9484-6e86a360396c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:23.398498 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-589b5510-1aa9-4a57-9484-6e86a360396c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115991 Aug 08 00:25:23.399391 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 00:25:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:25:25.599642 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-6fe3066e-a0ea-4c89-bf3f-d46eefe97b2b admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:25.600698 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-6fe3066e-a0ea-4c89-bf3f-d46eefe97b2b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 08 00:25:25.601093 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:26.043709 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-25dabb90-f992-4bde-bd09-d1ac3161919d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "vcpus": 4, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:26.158997 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-25dabb90-f992-4bde-bd09-d1ac3161919d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.551655 Aug 08 00:25:26.159583 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:25:26.172183 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-ba0a55e5-625a-4134-9387-0202c7124505 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:26.244828 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-ba0a55e5-625a-4134-9387-0202c7124505 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076440 Aug 08 00:25:26.247217 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Aug 8 00:25:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:25:28.560937 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-25dabb90-f992-4bde-bd09-d1ac3161919d admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:28.562296 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-25dabb90-f992-4bde-bd09-d1ac3161919d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Aug 08 00:25:28.562845 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:28.979156 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-d4fbd462-7370-4225-82b4-dfcebeb3e5de admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:29.003481 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-d4fbd462-7370-4225-82b4-dfcebeb3e5de admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.431407 Aug 08 00:25:29.004019 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 8 00:25:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:25:31.266960 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-25dabb90-f992-4bde-bd09-d1ac3161919d admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:31.268230 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-25dabb90-f992-4bde-bd09-d1ac3161919d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Aug 08 00:25:31.268776 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:31.716958 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-1860028e-6001-4e7b-a129-f8cae6dc35d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "disk": 1, "ram": 512, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:31.781443 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-1860028e-6001-4e7b-a129-f8cae6dc35d9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.506869 Aug 08 00:25:31.782728 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:25:31.794822 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-243edd03-59fa-4aa1-9f36-6c346be6e184 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:31.894472 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-243edd03-59fa-4aa1-9f36-6c346be6e184 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103204 Aug 08 00:25:31.895076 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 00:25:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:25:34.177639 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-1860028e-6001-4e7b-a129-f8cae6dc35d9 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:34.178759 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-1860028e-6001-4e7b-a129-f8cae6dc35d9 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 08 00:25:34.179259 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:34.576218 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-05ab2e17-3bba-4eff-b8e6-c5bc138d6c14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:34.637771 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-05ab2e17-3bba-4eff-b8e6-c5bc138d6c14 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452263 Aug 08 00:25:34.638329 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 00:25:34.651150 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-6d0e86d4-5f9d-433e-aaa5-ea948c06580d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:34.733225 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-6d0e86d4-5f9d-433e-aaa5-ea948c06580d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085790 Aug 08 00:25:34.736884 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 00:25:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:25:37.002638 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-05ab2e17-3bba-4eff-b8e6-c5bc138d6c14 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:37.003677 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-05ab2e17-3bba-4eff-b8e6-c5bc138d6c14 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 08 00:25:37.004106 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:37.400028 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-d47e63da-18c8-4dfe-9d07-144db1233f7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:37.524561 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-d47e63da-18c8-4dfe-9d07-144db1233f7b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.513453 Aug 08 00:25:37.525131 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 00:25:37.537729 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-aeb7ba7f-5436-498f-8713-76ea95a160e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:37.625664 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-aeb7ba7f-5436-498f-8713-76ea95a160e7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091261 Aug 08 00:25:37.631460 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 00:25:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:25:39.858126 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-d47e63da-18c8-4dfe-9d07-144db1233f7b admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:39.859123 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-d47e63da-18c8-4dfe-9d07-144db1233f7b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 08 00:25:39.863560 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:39 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:40.306077 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-1922534b-b12a-4e8a-b073-6de72210be72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:41.049129 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:25:41.056850 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-1922534b-b12a-4e8a-b073-6de72210be72 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.190849 Aug 08 00:25:41.060276 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 00:25:41.073539 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-03a7c27a-e6c7-4683-baeb-2c8bee0a8139 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:41.333794 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-03a7c27a-e6c7-4683-baeb-2c8bee0a8139 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.263893 Aug 08 00:25:41.335055 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 00:25:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:25:43.553029 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-1922534b-b12a-4e8a-b073-6de72210be72 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:25:43.554033 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-1922534b-b12a-4e8a-b073-6de72210be72 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 08 00:25:43.554429 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:25:43.991983 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-ac9786c4-245d-40ab-b33b-a4dcf253d25f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:44.050710 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-ac9786c4-245d-40ab-b33b-a4dcf253d25f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.490227 Aug 08 00:25:44.051590 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Aug 8 00:25:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:25:44.064159 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-d5064505-0086-4568-8521-0265a9bdefbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:25:44.150365 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-d5064505-0086-4568-8521-0265a9bdefbc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090675 Aug 08 00:25:44.151089 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Aug 8 00:25:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:26:03.461117 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-ac9786c4-245d-40ab-b33b-a4dcf253d25f admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:03.462035 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-ac9786c4-245d-40ab-b33b-a4dcf253d25f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 08 00:26:03.462427 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:26:03.860463 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-827d4863-bbda-4b3c-a1d1-a7474abfbcc1 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:03.878275 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-827d4863-bbda-4b3c-a1d1-a7474abfbcc1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409636 Aug 08 00:26:03.878801 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 8 00:26:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:26:04.945993 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-ac9786c4-245d-40ab-b33b-a4dcf253d25f admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:04.946996 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-ac9786c4-245d-40ab-b33b-a4dcf253d25f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 08 00:26:04.947418 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:26:05.466103 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-eba39941-7b9b-4e4b-93b8-f46cc5d7d3cb admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:05.471831 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.wsgi [None req-eba39941-7b9b-4e4b-93b8-f46cc5d7d3cb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-eba39941-7b9b-4e4b-93b8-f46cc5d7d3cb admin admin] Request method failure captured: Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Accept: application/json Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Accept-Encoding: gzip, deflate Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Connection: keep-alive Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Content-Length: 0 Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Host: 10.222.0.15 Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Openstack-Api-Version: compute 2.90 Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Openstack-System-Scope: None Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: User-Agent: python-novaclient Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Auth-Token: gAAAAABi8FgcJ5NX-tz1WzngTNStVZshoJ5Edkr8TCnniyLBq6VmZDCGIUQuXeGnelh9o4B3bZ8WDZHf0hP07W7wky-0wJUPFgHBr63NyhZyPOXlTWwfcheQirJqFSkBb5h41fhqA9V5xtB-52ErRo6V_LJuImEmfrd1kIcpoqu3ZRhmlAcSTzA Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Domain-Id: None Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Domain-Name: None Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Identity-Status: Confirmed Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Is-Admin-Project: True Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Domain-Id: default Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Domain-Name: Default Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Name: admin Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Role: admin,reader,member Aug 08 00:26:05.475017 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Roles: admin,reader,member Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/311e504f385e4c32bdb056e763a01299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_311e504f385e4c32bdb056e763a01299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Tenant: admin Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Tenant-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Tenant-Name: admin Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User: admin Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Domain-Id: default Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Domain-Name: Default Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Id: de917b8f456944dc9d27423048f81375 Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Name: admin Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: method: > Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: exception: Flavor 42 could not be found. Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: action_args: {'id': '42'} Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:26:05.476703 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:05.477758 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.479255 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-eba39941-7b9b-4e4b-93b8-f46cc5d7d3cb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115205) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:26:05.480602 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-eba39941-7b9b-4e4b-93b8-f46cc5d7d3cb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388527 Aug 08 00:26:05.480602 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 8 00:26:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:05.486914 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-d0be6aff-683a-45a0-af85-30dd6c7abbbc admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:05.491084 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:26:05.509932 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-d0be6aff-683a-45a0-af85-30dd6c7abbbc admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027066 Aug 08 00:26:05.510464 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 00:26:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:26:05.520250 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-5158be3f-2263-42fe-b79e-844b5a5887f6 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:05.544035 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-5158be3f-2263-42fe-b79e-844b5a5887f6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027458 Aug 08 00:26:05.544562 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 00:26:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:26:05.554999 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-4b9a81bf-df68-4ee3-b5a8-7efb8b46d2a7 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:05.560724 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.wsgi [None req-4b9a81bf-df68-4ee3-b5a8-7efb8b46d2a7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-4b9a81bf-df68-4ee3-b5a8-7efb8b46d2a7 admin admin] Request method failure captured: Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Accept: application/json Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Accept-Encoding: gzip, deflate Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Connection: keep-alive Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Content-Length: 0 Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Host: 10.222.0.15 Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Openstack-Api-Version: compute 2.90 Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Openstack-System-Scope: None Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: User-Agent: python-novaclient Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Auth-Token: gAAAAABi8FgcJ5NX-tz1WzngTNStVZshoJ5Edkr8TCnniyLBq6VmZDCGIUQuXeGnelh9o4B3bZ8WDZHf0hP07W7wky-0wJUPFgHBr63NyhZyPOXlTWwfcheQirJqFSkBb5h41fhqA9V5xtB-52ErRo6V_LJuImEmfrd1kIcpoqu3ZRhmlAcSTzA Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Domain-Id: None Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Domain-Name: None Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Identity-Status: Confirmed Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Is-Admin-Project: True Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Domain-Id: default Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Domain-Name: Default Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Name: admin Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Role: admin,reader,member Aug 08 00:26:05.566053 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Roles: admin,reader,member Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/311e504f385e4c32bdb056e763a01299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_311e504f385e4c32bdb056e763a01299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Tenant: admin Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Tenant-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Tenant-Name: admin Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User: admin Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Domain-Id: default Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Domain-Name: Default Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Id: de917b8f456944dc9d27423048f81375 Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Name: admin Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: method: > Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: exception: Flavor 42 could not be found. Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: action_args: {'id': '42'} Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:26:05.567567 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:05.568363 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:05.569395 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-4b9a81bf-df68-4ee3-b5a8-7efb8b46d2a7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:26:05.570377 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-4b9a81bf-df68-4ee3-b5a8-7efb8b46d2a7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015137 Aug 08 00:26:05.570377 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 8 00:26:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:06.529744 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-5158be3f-2263-42fe-b79e-844b5a5887f6 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:06.530732 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-5158be3f-2263-42fe-b79e-844b5a5887f6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 08 00:26:06.531119 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:26:07.052383 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-4ec340a1-82b8-4ec3-b1d5-7613bde007c4 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:07.059665 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.wsgi [None req-4ec340a1-82b8-4ec3-b1d5-7613bde007c4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-4ec340a1-82b8-4ec3-b1d5-7613bde007c4 admin admin] Request method failure captured: Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Accept: application/json Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Accept-Encoding: gzip, deflate Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Connection: keep-alive Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Content-Length: 0 Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Host: 10.222.0.15 Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Openstack-Api-Version: compute 2.90 Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Openstack-System-Scope: None Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: User-Agent: python-novaclient Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Auth-Token: gAAAAABi8FgePn2U60BEjSjWTV5pQRTaHP9f2iZ7Rle3k7TETm4TqiEdSzPLQ4Z2WvfyzyrkreH-t8-Ygdla7JRkJFrMTA5P0oI7A4LkyhAT00nSmPv6nXlutIt3g86sQCqBuBwpuZWIon511TInslHalWq1XsjDZsG-2EjxKc-9Szi10n0w_Y4 Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Domain-Id: None Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Domain-Name: None Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Identity-Status: Confirmed Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Is-Admin-Project: True Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Domain-Id: default Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Domain-Name: Default Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Name: admin Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Role: admin,reader,member Aug 08 00:26:07.061149 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Roles: admin,reader,member Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/311e504f385e4c32bdb056e763a01299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_311e504f385e4c32bdb056e763a01299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Tenant: admin Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Tenant-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Tenant-Name: admin Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User: admin Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Domain-Id: default Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Domain-Name: Default Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Id: de917b8f456944dc9d27423048f81375 Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Name: admin Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: method: > Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: exception: Flavor 84 could not be found. Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: action_args: {'id': '84'} Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:26:07.062688 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:07.063851 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.065287 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-4ec340a1-82b8-4ec3-b1d5-7613bde007c4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:26:07.066537 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-4ec340a1-82b8-4ec3-b1d5-7613bde007c4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391283 Aug 08 00:26:07.066537 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 8 00:26:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:07.072169 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-ab85867e-a95a-47c5-9bf4-9e4c3503db59 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:07.087821 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-ab85867e-a95a-47c5-9bf4-9e4c3503db59 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019123 Aug 08 00:26:07.088313 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 00:26:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:26:07.098416 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-3d67bcee-d516-41f8-8d10-d23f680c0477 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:07.113274 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-3d67bcee-d516-41f8-8d10-d23f680c0477 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019143 Aug 08 00:26:07.113825 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 00:26:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:26:07.122859 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-283f2147-8d2d-47a4-82c3-86eaa907c698 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:07.128826 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.wsgi [None req-283f2147-8d2d-47a4-82c3-86eaa907c698 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-283f2147-8d2d-47a4-82c3-86eaa907c698 admin admin] Request method failure captured: Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Accept: application/json Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Accept-Encoding: gzip, deflate Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Connection: keep-alive Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Content-Length: 0 Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Host: 10.222.0.15 Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Openstack-Api-Version: compute 2.90 Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Openstack-System-Scope: None Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: User-Agent: python-novaclient Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Auth-Token: gAAAAABi8FgePn2U60BEjSjWTV5pQRTaHP9f2iZ7Rle3k7TETm4TqiEdSzPLQ4Z2WvfyzyrkreH-t8-Ygdla7JRkJFrMTA5P0oI7A4LkyhAT00nSmPv6nXlutIt3g86sQCqBuBwpuZWIon511TInslHalWq1XsjDZsG-2EjxKc-9Szi10n0w_Y4 Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Domain-Id: None Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Domain-Name: None Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Identity-Status: Confirmed Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Is-Admin-Project: True Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Domain-Id: default Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Domain-Name: Default Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Name: admin Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Role: admin,reader,member Aug 08 00:26:07.130318 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Roles: admin,reader,member Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/311e504f385e4c32bdb056e763a01299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_311e504f385e4c32bdb056e763a01299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Tenant: admin Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Tenant-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Tenant-Name: admin Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User: admin Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Domain-Id: default Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Domain-Name: Default Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Id: de917b8f456944dc9d27423048f81375 Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Name: admin Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: method: > Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: exception: Flavor 84 could not be found. Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: action_args: {'id': '84'} Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:26:07.131948 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:07.132992 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:07.134333 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-283f2147-8d2d-47a4-82c3-86eaa907c698 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115205) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:26:07.135687 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-283f2147-8d2d-47a4-82c3-86eaa907c698 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012242 Aug 08 00:26:07.135687 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Aug 8 00:26:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:08.092360 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-3d67bcee-d516-41f8-8d10-d23f680c0477 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:08.093358 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-3d67bcee-d516-41f8-8d10-d23f680c0477 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 08 00:26:08.093757 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:26:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:26:08.735217 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-448e4b15-e516-43f0-ba6d-78705a3d726f admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:08.741077 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.wsgi [None req-448e4b15-e516-43f0-ba6d-78705a3d726f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-448e4b15-e516-43f0-ba6d-78705a3d726f admin admin] Request method failure captured: Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Accept: application/json Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Accept-Encoding: gzip, deflate Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Connection: keep-alive Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Content-Length: 0 Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Host: 10.222.0.15 Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Openstack-Api-Version: compute 2.90 Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Openstack-System-Scope: None Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: User-Agent: python-novaclient Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Auth-Token: gAAAAABi8Fgfvw4OOovrPxZn0CT1Lr6xhcfm5MOw-aXjqhFrqZQHwFLc-BZ78vgKkLoTr1zAPuCk5L99_-QsLf6a1-7JlWqgGq7oaAPGsM5ZDKRYfcFSv7CMGrj2CejrpD4J-iZvvxsdFoSaSHBH-19p4QLohRu9HoXjoqMY07tb2ujAd6W60nk Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Domain-Id: None Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Domain-Name: None Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Identity-Status: Confirmed Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Is-Admin-Project: True Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Domain-Id: default Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Domain-Name: Default Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Project-Name: admin Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Role: admin,reader,member Aug 08 00:26:08.742552 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Roles: admin,reader,member Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/311e504f385e4c32bdb056e763a01299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_311e504f385e4c32bdb056e763a01299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Tenant: admin Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Tenant-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-Tenant-Name: admin Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User: admin Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Domain-Id: default Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Domain-Name: Default Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Id: de917b8f456944dc9d27423048f81375 Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: X-User-Name: admin Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: method: > Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: exception: Flavor 451 could not be found. Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: action_args: {'id': '451'} Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:26:08.744146 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:08.748005 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.749100 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-448e4b15-e516-43f0-ba6d-78705a3d726f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115205) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:26:08.750301 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-448e4b15-e516-43f0-ba6d-78705a3d726f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.511867 Aug 08 00:26:08.750301 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 00:26:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 513 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:08.754313 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-cba3148e-58fa-4404-bf8f-8a8b2a415bc6 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:08.769645 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-cba3148e-58fa-4404-bf8f-8a8b2a415bc6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019626 Aug 08 00:26:08.770175 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 00:26:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:26:08.779673 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:08.795059 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018852 Aug 08 00:26:08.795609 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Aug 8 00:26:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:26:08.805501 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-0b3e7110-0169-4bc8-bc72-bd96f5365aac admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:08.810745 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.wsgi [None req-0b3e7110-0169-4bc8-bc72-bd96f5365aac admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-0b3e7110-0169-4bc8-bc72-bd96f5365aac admin admin] Request method failure captured: Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Accept: application/json Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Accept-Encoding: gzip, deflate Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Connection: keep-alive Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Content-Length: 0 Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Host: 10.222.0.15 Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Openstack-Api-Version: compute 2.90 Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Openstack-System-Scope: None Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: User-Agent: python-novaclient Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Auth-Token: gAAAAABi8Fgfvw4OOovrPxZn0CT1Lr6xhcfm5MOw-aXjqhFrqZQHwFLc-BZ78vgKkLoTr1zAPuCk5L99_-QsLf6a1-7JlWqgGq7oaAPGsM5ZDKRYfcFSv7CMGrj2CejrpD4J-iZvvxsdFoSaSHBH-19p4QLohRu9HoXjoqMY07tb2ujAd6W60nk Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Domain-Id: None Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Domain-Name: None Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Identity-Status: Confirmed Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Is-Admin-Project: True Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Openstack-Nova-Api-Version: 2.90 Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Domain-Id: default Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Domain-Name: Default Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Project-Name: admin Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Role: admin,reader,member Aug 08 00:26:08.812262 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Roles: admin,reader,member Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/311e504f385e4c32bdb056e763a01299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/311e504f385e4c32bdb056e763a01299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_311e504f385e4c32bdb056e763a01299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Tenant: admin Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Tenant-Id: 311e504f385e4c32bdb056e763a01299 Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-Tenant-Name: admin Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User: admin Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Domain-Id: default Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Domain-Name: Default Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Id: de917b8f456944dc9d27423048f81375 Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: X-User-Name: admin Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: method: > Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: exception: Flavor 451 could not be found. Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: action_args: {'id': '451'} Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:26:08.814112 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:08.814926 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: ERROR nova.api.openstack.wsgi Aug 08 00:26:08.816050 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-0b3e7110-0169-4bc8-bc72-bd96f5365aac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:26:08.817097 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-0b3e7110-0169-4bc8-bc72-bd96f5365aac admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011699 Aug 08 00:26:08.817097 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 00:26:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 08 00:26:09.769313 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:09.770354 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 08 00:26:09.770771 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:26:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:26:10.287908 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-2dd27885-36a1-4084-8ad1-5798049b71c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:26:10.352482 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-2dd27885-36a1-4084-8ad1-5798049b71c1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.442014 Aug 08 00:26:10.353033 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 8 00:26:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:26:11.325716 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:11.326709 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 08 00:26:11.327102 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:26:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:26:11.848532 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-920f56db-27be-42c8-a0ac-b8e05fcb7f77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:26:11.933838 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-920f56db-27be-42c8-a0ac-b8e05fcb7f77 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.469773 Aug 08 00:26:11.934385 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 8 00:26:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:26:12.908130 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:12.909135 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002097 Aug 08 00:26:12.909527 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:26:13.431761 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-27998c51-5d55-4287-a290-e89548133ad1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:26:13.511861 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-27998c51-5d55-4287-a290-e89548133ad1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.464149 Aug 08 00:26:13.512501 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 8 00:26:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 00:26:14.490744 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:14.491783 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 08 00:26:14.492178 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:26:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:26:15.008318 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-c0e67d68-470b-4c15-8615-7b12bd0f1c84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:26:15.083212 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-c0e67d68-470b-4c15-8615-7b12bd0f1c84 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.452116 Aug 08 00:26:15.083719 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Aug 8 00:26:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:26:16.057949 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:16.058985 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 08 00:26:16.059423 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:26:16.581965 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-d558ead3-494c-4bbf-b577-343ff88b49a4 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:26:16.602407 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-d558ead3-494c-4bbf-b577-343ff88b49a4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401989 Aug 08 00:26:16.602944 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Mon Aug 8 00:26:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:27:08.092348 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:27:08.093346 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-b0d6d583-933b-434e-87b7-2fd1da2f82c0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 08 00:27:08.093739 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Mon Aug 8 00:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:27:08.104932 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:27:08.477910 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-8a6d84fc-77f0-4965-b9f3-73a83f24411c admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:27:08.497740 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-8a6d84fc-77f0-4965-b9f3-73a83f24411c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397561 Aug 08 00:27:08.498265 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Aug 8 00:27:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:27:08.522195 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-af567bde-5002-4af9-8f2e-58385d642928 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:27:08.525576 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG dbcounter [-] [115205] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=115205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:27:08.530681 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-af567bde-5002-4af9-8f2e-58385d642928 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012084 Aug 08 00:27:08.533459 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Aug 8 00:27:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:27:08.543236 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-0b123b2c-609a-4330-b39a-0ab544c3b789 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:27:08.550873 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-0b123b2c-609a-4330-b39a-0ab544c3b789 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011128 Aug 08 00:27:08.551400 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Aug 8 00:27:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:27:08.562447 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:27:08.570769 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011820 Aug 08 00:27:08.571307 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Aug 8 00:27:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:27:08.583408 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-89d2282a-186a-41a3-9298-d8ee27576010 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:27:08.591008 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-89d2282a-186a-41a3-9298-d8ee27576010 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011910 Aug 08 00:27:08.591591 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Aug 8 00:27:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:30:24.507739 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:30:24.508749 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 08 00:30:24.509143 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:30:24.647836 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_api:SELECT=6 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:24.807310 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-13b7aae1-7088-4c15-a562-c9028bed28d2 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:30:24.809783 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:30:24.809783 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: warnings.warn(msg) Aug 08 00:30:24.810917 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-13b7aae1-7088-4c15-a562-c9028bed28d2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:30:24.811426 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-13b7aae1-7088-4c15-a562-c9028bed28d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:30:24.814046 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-13b7aae1-7088-4c15-a562-c9028bed28d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:30:24.814046 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-13b7aae1-7088-4c15-a562-c9028bed28d2 admin admin] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:30:24.814046 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-13b7aae1-7088-4c15-a562-c9028bed28d2 admin admin] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:30:24.814046 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-13b7aae1-7088-4c15-a562-c9028bed28d2 admin admin] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:30:24.847800 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-13b7aae1-7088-4c15-a562-c9028bed28d2 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201535 Aug 08 00:30:24.848366 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 00:30:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:30:25.681809 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:30:25.682812 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 08 00:30:25.683208 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:30:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:30:25.875499 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-d6340e9f-9650-4855-88fb-50f2f0523ef1 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:30:25.877459 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:30:25.877459 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: warnings.warn(msg) Aug 08 00:30:25.878554 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-d6340e9f-9650-4855-88fb-50f2f0523ef1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:30:25.879029 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-d6340e9f-9650-4855-88fb-50f2f0523ef1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:30:25.879477 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-d6340e9f-9650-4855-88fb-50f2f0523ef1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:30:25.880185 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-d6340e9f-9650-4855-88fb-50f2f0523ef1 admin admin] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:30:25.880625 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-d6340e9f-9650-4855-88fb-50f2f0523ef1 admin admin] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:30:25.881044 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-d6340e9f-9650-4855-88fb-50f2f0523ef1 admin admin] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:30:25.901511 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-d6340e9f-9650-4855-88fb-50f2f0523ef1 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078988 Aug 08 00:30:25.901990 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 00:30:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:30:37.156566 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:30:37.157597 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 08 00:30:37.157993 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:30:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:30:37.299868 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_cell0:SELECT=4 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:37.300604 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_cell1:SELECT=4 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:37.301226 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG dbcounter [-] [115204] Writing DB stats nova_api:SELECT=8 {{(pid=115204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:30:37.349266 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-face2ee7-cf42-442d-a6aa-653a16c18823 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:30:37.351666 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:30:37.351666 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: warnings.warn(msg) Aug 08 00:30:37.352829 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-face2ee7-cf42-442d-a6aa-653a16c18823 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:30:37.353367 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-face2ee7-cf42-442d-a6aa-653a16c18823 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:30:37.353883 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-face2ee7-cf42-442d-a6aa-653a16c18823 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:30:37.354620 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-face2ee7-cf42-442d-a6aa-653a16c18823 admin admin] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:30:37.355066 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-face2ee7-cf42-442d-a6aa-653a16c18823 admin admin] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:30:37.355519 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-face2ee7-cf42-442d-a6aa-653a16c18823 admin admin] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:30:37.383820 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-face2ee7-cf42-442d-a6aa-653a16c18823 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085900 Aug 08 00:30:37.383820 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 00:30:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:30:38.203102 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: DEBUG nova.api.openstack.wsgi [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] Calling method '>' {{(pid=115205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:30:38.204125 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: INFO nova.api.openstack.requestlog [None req-e79c54a7-bb93-41ef-9572-907236261cf6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 08 00:30:38.204518 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: [pid: 115205|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Aug 8 00:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:30:38.397267 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG nova.api.openstack.wsgi [None req-fccecb23-dbc2-450b-affd-d1e021b59bc4 admin admin] Calling method '>' {{(pid=115204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:30:38.399655 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 00:30:38.399655 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: warnings.warn(msg) Aug 08 00:30:38.400825 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-fccecb23-dbc2-450b-affd-d1e021b59bc4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:30:38.401289 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-fccecb23-dbc2-450b-affd-d1e021b59bc4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:30:38.401708 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-fccecb23-dbc2-450b-affd-d1e021b59bc4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:30:38.402416 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-fccecb23-dbc2-450b-affd-d1e021b59bc4 admin admin] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:30:38.402844 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-fccecb23-dbc2-450b-affd-d1e021b59bc4 admin admin] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:30:38.403265 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: DEBUG oslo_concurrency.lockutils [None req-fccecb23-dbc2-450b-affd-d1e021b59bc4 admin admin] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:30:38.425706 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: INFO nova.api.openstack.requestlog [None req-fccecb23-dbc2-450b-affd-d1e021b59bc4 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079831 Aug 08 00:30:38.426177 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: [pid: 115204|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Aug 8 00:30:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:31:35.355653 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: Mon Aug 8 00:31:35 2022 - graceful shutdown triggered... Aug 08 00:31:35.355784 dv-cinder-851640-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 08 00:31:35.356773 dv-cinder-851640-3-iscsi devstack@n-api.service[115204]: Gracefully killing worker 1 (pid: 115204)... Aug 08 00:31:35.357200 dv-cinder-851640-3-iscsi devstack@n-api.service[115205]: Gracefully killing worker 2 (pid: 115205)... Aug 08 00:31:36.357866 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: worker 1 buried after 1 seconds Aug 08 00:31:36.358413 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: worker 2 buried after 1 seconds Aug 08 00:31:36.358413 dv-cinder-851640-3-iscsi devstack@n-api.service[115203]: goodbye to uWSGI. Aug 08 00:31:36.359557 dv-cinder-851640-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 08 00:31:36.360175 dv-cinder-851640-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 08 00:31:36.363276 dv-cinder-851640-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 08 00:31:36.373751 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 00:31:36 2022] *** Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: nodename: dv-cinder-851640-3-iscsi Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: machine: x86_64 Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: clock source: unix Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: pcre jit disabled Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: detected number of CPU cores: 4 Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: current working directory: / Aug 08 00:31:36.375681 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: detected binary path: /usr/bin/uwsgi-core Aug 08 00:31:36.376353 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: your processes number limit is 47680 Aug 08 00:31:36.376353 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: your memory page size is 4096 bytes Aug 08 00:31:36.376353 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: detected max file descriptor number: 2048 Aug 08 00:31:36.376353 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: lock engine: pthread robust mutexes Aug 08 00:31:36.376353 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: thunder lock: enabled Aug 08 00:31:36.376353 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 08 00:31:36.376353 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 00:31:36.417128 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: Python main interpreter initialized at 0x55cdd36eb9c0 Aug 08 00:31:36.417128 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: python threads support enabled Aug 08 00:31:36.417128 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: your server socket listen backlog is limited to 100 connections Aug 08 00:31:36.417128 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: your mercy for graceful operations on workers is 90 seconds Aug 08 00:31:36.417535 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 00:31:36.417606 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: *** Operational MODE: preforking *** Aug 08 00:31:36.417833 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: *** uWSGI is running in multiple interpreter mode *** Aug 08 00:31:36.417833 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: spawned uWSGI master process (pid: 130161) Aug 08 00:31:36.418034 dv-cinder-851640-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 08 00:31:36.418918 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: spawned uWSGI worker 1 (pid: 130172, cores: 1) Aug 08 00:31:36.418918 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: spawned uWSGI worker 2 (pid: 130173, cores: 1) Aug 08 00:31:36.419106 dv-cinder-851640-3-iscsi devstack@n-api.service[130161]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 00:31:37.093669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 00:31:37.094275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 08 00:31:38.255072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:31:38.255072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: from cryptography.utils import int_from_bytes Aug 08 00:31:38.255934 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:31:38.255934 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: from cryptography.utils import int_from_bytes Aug 08 00:31:38.256367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:31:38.256367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: from cryptography.utils import int_from_bytes Aug 08 00:31:38.256511 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 00:31:38.256511 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: from cryptography.utils import int_from_bytes Aug 08 00:31:40.590409 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 00:31:40.590998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 00:31:40.591338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 00:31:40.591590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 00:31:40.591851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 00:31:40.592244 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.592581 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.592902 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.593224 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.593561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.593875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.594199 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.594520 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.594890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.595149 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.595491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.595822 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-3-iscsi {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.596147 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.596458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.596774 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.597096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.597401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.597727 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.598047 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.598152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 00:31:40.598523 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 00:31:40.598622 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.600442 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 00:31:40.600569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.600744 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 00:31:40.600837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.600912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 00:31:40.600994 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601073 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601152 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601152 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601302 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601459 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601540 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601731 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601901 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.601975 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.602054 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.602155 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.602155 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.602323 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-3-iscsi {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.602762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.602992 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.603214 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.603473 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.603741 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.603951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.604166 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-3-iscsi {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.604399 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.604652 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.604898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.605114 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.605332 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.605552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.605775 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.606078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.606294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.606486 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.606695 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.606872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.607070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.607291 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.608575 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.608575 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.608925 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.609145 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.609306 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.609458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.609603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.609752 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.609924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.610096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.610251 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.610427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.610675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.610876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.611023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.611181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.611346 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.611502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.611644 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.611821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.611966 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.612121 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.612998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.613162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.613316 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-3-iscsi {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.613470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.613630 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.613775 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.613775 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.614057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.614682 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.615003 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.615155 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.615334 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.615510 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.615844 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.616849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.617052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.617215 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.617368 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.617548 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.617548 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.619355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.619564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.619766 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.619968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.620146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.620301 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.620484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.620637 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.620780 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.620932 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.621141 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.621289 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.621479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.621635 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.621778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.621927 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.623207 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.623401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.623599 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.623756 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.623907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.624059 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.624202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.624391 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.624580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.624772 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.624921 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.625106 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.625295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.625531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.625718 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.631596 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.631798 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.631975 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.632124 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.632302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.632454 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.632654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.632804 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.632959 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.633112 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.633277 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.633421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.633569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.633754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.634022 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.634194 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.634345 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.634488 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.634657 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.634870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.635026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.635187 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.635357 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.635524 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.635674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.635674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.635998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.636149 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.636300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.636442 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.636607 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.636802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.637000 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.637144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.637310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.637474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.637625 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.637775 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.637962 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.638129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.638308 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.638467 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.638610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.638758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.638945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.639103 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.639103 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.639415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.639578 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.640062 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.640233 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.640379 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.640521 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.641061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.641221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.641382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.641526 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.643094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.643342 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.643342 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.643624 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.643786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.643930 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.644071 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.644423 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.645481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.646256 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.646452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.646602 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.646762 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.646905 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.646905 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.647208 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.647401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.647550 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.648145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.648297 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.648488 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.648643 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.648794 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.649056 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.649208 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.649359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.649502 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.649643 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.649784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.650146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.650311 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.650465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.650609 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.650769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.651380 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.652595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.652774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.652922 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.653092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.653241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.653395 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.653561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.653706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.653858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.654001 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.654151 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.654356 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.654566 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.654566 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.655150 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.660177 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.660360 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.660523 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.660705 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.660866 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.661049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.661251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.661424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.661577 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.661751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.661751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.662087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.662232 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.662381 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.662538 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.662716 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.662863 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.663029 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.663181 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.663364 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.663509 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.663658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.663844 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.664029 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.664185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.664328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.664477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.664628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.664785 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.664939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.669031 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.669216 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.669369 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.669522 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.669678 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.671337 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.671568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.671729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.671877 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.672022 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.672176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.672327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.672513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.672659 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.672810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.673587 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.673764 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.673922 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.674075 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.674075 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.674357 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.675282 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.676077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.676238 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.677039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.677207 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.677370 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.677516 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.677666 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.677819 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 00:31:40.677970 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.678113 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.678265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.678834 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.679005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.679152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.679394 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.679901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.680067 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.680227 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.680380 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.680539 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.680698 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.680849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.681044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.681201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.681351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.681495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.681644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.681813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.681974 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.682151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.682298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.682451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.682594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.682737 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.682887 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.683051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.683340 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.683505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.683650 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.683831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.683999 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.684152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.684294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.684435 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.684594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.684923 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.685368 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.685522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.685674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.685929 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.686086 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.686209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.686330 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.686467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.686914 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.687077 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.687205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.689332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.690018 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.690188 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.690347 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.690492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.690634 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.690874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.691045 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.691289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.691478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.691478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.691776 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.691776 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.692053 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.692209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.692402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.692402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.692680 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.692821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.692963 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.693179 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.693372 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.693521 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.693673 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.693824 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.693966 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.694117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.694260 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.694458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.694609 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.694751 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.695083 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.695567 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.695733 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.695889 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.696048 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.696192 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.696348 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.696491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.696634 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.697174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.697325 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.697468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.697618 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.697771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.697934 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.698077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.698234 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.698386 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.698538 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.698688 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.698840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.698983 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.699125 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.699313 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.699478 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.699666 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.699820 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.699976 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.700142 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.700294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.700445 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.700592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.700740 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.700897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.701054 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.701217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.701367 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.701531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.701692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.701842 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.702003 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.702161 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.702329 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.702694 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.702800 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.702875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.702967 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.703066 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.703159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.703263 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.703399 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.703531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.703712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.703845 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.703845 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.704867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.705229 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.705607 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.705727 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.705817 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.705901 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.705985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.706076 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.706161 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.706258 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.706344 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.706426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.706803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.707048 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.707338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.707453 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.707541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.707633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.707766 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.707859 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.707952 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.708037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.708128 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.708214 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.708348 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.708469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.708681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.708783 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.708868 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.708967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.709053 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.709144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.709882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.709974 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710058 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710233 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710318 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710478 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710666 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710756 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.710934 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711019 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711397 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711492 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711589 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.711947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.712076 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.712224 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.712356 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.712485 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.712625 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.712714 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.712797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.712890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.712975 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713140 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713229 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713331 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713511 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713593 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713676 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.713955 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.714047 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.714139 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.714271 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.714366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.714366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.714588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.714673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.714756 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.714846 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.715044 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.724776 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.724961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.725400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.725585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.725839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.726010 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.726165 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.726310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.726488 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.726632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.726814 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.726982 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.727153 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.727535 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.727690 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.727834 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.728047 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.728209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.728361 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.728548 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.728705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.728856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.729000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.729157 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.729333 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.729485 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.729636 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.729779 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.729927 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.730090 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.730236 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.730377 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.730518 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.730696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.730857 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731009 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731492 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731492 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731899 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.731996 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732081 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732269 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732370 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732462 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732690 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732879 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.732964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733047 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733226 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733483 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733656 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733750 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.733926 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734011 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734420 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734503 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734503 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734762 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.734941 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.735025 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.735108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.735197 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.735315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.735719 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.735830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736028 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736124 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736219 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736468 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736636 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736727 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.736958 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.737056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.737141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.737232 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.737328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.737435 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.737531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.737623 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.737715 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.737810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.738009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.738150 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.738280 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.738405 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.738531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.738661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.738790 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.738894 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.738987 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739072 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739155 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739262 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.739924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.740064 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.740194 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.740322 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.740410 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.740546 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.740654 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.740762 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.740901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.740988 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741079 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741170 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741354 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741637 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741723 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741807 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.741972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.742063 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.742156 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.742241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.742330 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.742421 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.742421 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.742421 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.742421 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.742711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.747746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.747906 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748316 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748405 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.748944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749282 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.749893 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750195 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750409 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750574 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750824 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750900 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.750999 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751183 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751390 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751471 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751781 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751863 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.751947 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752093 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752172 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752172 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752326 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752488 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752562 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752642 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752725 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752799 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752877 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.752958 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753330 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753643 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753725 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753799 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753872 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.753944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754023 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754107 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754268 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754505 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754686 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754855 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.754948 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755203 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755431 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755587 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755587 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755761 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.755922 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.756044 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.756196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.756360 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.756500 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.756625 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.756727 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.756822 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.756936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757038 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757134 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757222 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757521 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757609 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757694 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757780 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757865 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.757950 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758051 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758140 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758277 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758368 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758559 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758660 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758756 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758893 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.758983 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.759099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.759198 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.759418 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.759524 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.759613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.759699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.759792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.759893 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.759992 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.760084 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.760223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.760323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.760467 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.760612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.760755 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.760855 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.760943 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761028 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761114 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761297 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761384 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761476 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761571 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761668 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761763 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.761953 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762133 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762234 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762507 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762888 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.762984 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.763079 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.763166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.763284 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.763446 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.763553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.763553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.763720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.763814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.763910 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764005 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764098 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764286 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764373 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764457 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.764994 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.765081 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.765172 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.765280 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.765434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.765568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.765568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.765801 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.765916 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.766030 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.766125 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.766210 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.766306 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.766400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.766539 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.767171 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.767355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.767551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.767717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.767816 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.767893 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.767979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.768072 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.768174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.768263 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.768408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.768499 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.768584 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.768719 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.768819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.768907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769137 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769226 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769321 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769493 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769585 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769779 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769876 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.769972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.770067 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.770196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.770311 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.770425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.770548 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.770692 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.770692 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.770945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.771069 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.771184 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.771338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.771510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.771633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.771633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.771836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772007 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772097 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772191 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772294 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772387 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772822 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.772907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773097 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773192 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773287 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773459 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773670 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773889 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.773976 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774071 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774369 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.774930 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.775023 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.775117 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.775212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.778795 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.778795 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.779162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.779162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.779381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.779478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.779625 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.779625 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.779848 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.779953 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780149 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780149 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780333 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780422 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780509 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780704 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780792 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.780929 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781054 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781320 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781518 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.781976 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.782064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.782212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.782848 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.782948 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783024 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783107 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783191 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783419 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783509 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783604 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783707 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783797 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783889 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.783984 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784079 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784264 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784548 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784634 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784815 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784911 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.784999 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785164 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785358 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785443 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785537 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785625 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785625 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785800 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785887 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.785983 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786084 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786172 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786268 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786362 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786457 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786551 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786792 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.786977 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.787071 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.787166 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.787272 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.787374 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.787472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.787567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.787701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.787812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.787946 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788154 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788508 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788593 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788751 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788837 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.788929 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.789026 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.789237 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.789237 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.789405 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.789492 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.789591 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.789766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.789864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790003 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790100 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790195 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790387 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790654 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.790928 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791067 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791198 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.791988 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792085 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792173 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792258 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792343 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792428 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792513 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792606 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792700 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.792890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793062 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793247 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793500 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793604 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793699 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793794 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.793940 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.794084 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.794202 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.794327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.794452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.794576 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.794689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.794803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.794923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.795053 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.795176 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.795363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.795489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.795605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.795753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.795847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.795922 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.796016 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.796104 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.796189 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.796307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.796438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.796561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.796685 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.796800 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.796928 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797308 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797488 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797587 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797776 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.797990 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.798097 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.798200 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.798296 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.798390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.798477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.798477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.798737 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.798844 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.798934 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.799074 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.799167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.799295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.799402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.799498 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.799595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.799696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.799784 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.799870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.800088 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.800196 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.800286 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.800415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.800557 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.800664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.800753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.800839 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.800932 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801020 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801154 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801259 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801344 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801427 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801607 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801687 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801891 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.801979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802254 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802342 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802608 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802694 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.802966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.803051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.803136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.803247 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.803393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.803519 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.803642 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.803766 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.803882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.803992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804186 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804273 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804359 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804443 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804539 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804714 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804807 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804894 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.804979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805252 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805344 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805532 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805630 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805718 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805888 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.805973 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806161 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806246 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806504 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806504 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.806956 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.807094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.807205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.807385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.807475 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.807561 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.807646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.807731 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.807831 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.807831 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.808023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.808107 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.808346 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.808520 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.808611 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.808698 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.808791 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.808887 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.808975 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809252 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809346 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809527 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809626 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809720 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809895 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.809980 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810093 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810252 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810335 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810423 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810606 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810708 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810881 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.810966 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.811052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.811151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.811372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.811516 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.811621 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.811749 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.811896 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.811998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812183 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812276 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812551 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812825 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.812912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.813013 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.813101 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.813187 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.813273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.813365 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.813494 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.813661 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.813829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.813972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.814091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.814262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.814385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.814486 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.814582 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.814677 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.814769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.814856 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.814971 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815069 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815259 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815259 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815651 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815737 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.815935 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816034 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816122 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816208 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816657 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816744 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816830 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.816930 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817123 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817208 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817283 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817384 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817475 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817592 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817690 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.817899 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818001 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818089 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818300 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818389 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818497 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818590 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818590 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818871 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.818960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819054 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819704 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819888 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819983 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.819983 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.820155 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.820243 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.820377 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.820488 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.820577 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.820713 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.820810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.820906 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.820994 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.821090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.821184 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.821274 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.821454 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.821582 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.821699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.821804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.821932 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822222 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822663 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822777 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822872 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.822969 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823065 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823160 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823271 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823374 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823571 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823668 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823757 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823842 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.823935 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824119 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824299 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824391 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824486 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824577 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824671 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824845 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.824942 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825037 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825138 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825233 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825320 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825555 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825668 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825764 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825860 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.825948 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.826061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.826157 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.826253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.826348 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.826460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.826552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.826648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.826820 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.826910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827176 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827302 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827391 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827466 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827650 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827735 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.827995 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.828101 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.828190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.828272 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.828380 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.828483 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.828685 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.828775 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.828914 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.829032 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.829701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.829701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830244 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830339 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830426 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830512 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830595 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.830938 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.831040 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.831136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.831244 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.831334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.831758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.831956 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.832112 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.832206 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.832354 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.832451 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.832660 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.832755 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.832968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.833074 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.833275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.833372 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.833583 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.833724 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.833886 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.834002 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.834198 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.834408 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.834509 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.834723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.834849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.835035 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.835133 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.835377 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.835490 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.835694 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.835802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.836002 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.836113 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.836311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.836409 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.836618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.836723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.836925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.837028 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.837228 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.837424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.837543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.837644 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.837875 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.837979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.838193 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.838299 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.838505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.838599 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.838816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.838912 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.839127 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.839261 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.839516 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.839655 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.839840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.839953 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.840164 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.840271 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.840476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.840571 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.840784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.840922 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.841117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.841220 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.841431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.841536 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.841744 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.841849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.842060 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.842196 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.842372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.842470 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.842685 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.842789 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.842997 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.843102 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.843364 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.843465 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.845446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.845642 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.845745 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.845842 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.845938 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846213 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846595 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846688 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846790 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846885 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.846974 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.847060 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.847145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.847262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.847354 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.847440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.847583 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.847682 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.847853 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.847960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.848158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.848262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.848465 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.848581 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.848778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.848884 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.849085 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.849193 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.849391 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.849487 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.849696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.849794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.850002 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.850095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.850311 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.850398 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.850615 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.850726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.850980 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.851079 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.851317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.851405 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.851658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.851765 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.851985 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.852077 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.852317 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.852470 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.852633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.852786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.853131 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.853249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.853339 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.853437 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.853534 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 00:31:40.853684 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.853990 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.854297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.854633 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.854969 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.855312 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.855642 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.855960 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.856410 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.856773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.857106 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.857429 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.857753 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.858069 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.858406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.858719 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.859034 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.859377 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.859691 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.860010 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.860311 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.860698 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.861039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.861355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.861685 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.862008 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.862392 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.862954 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.863312 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.863696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.863974 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.864289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.864602 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.864915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.865228 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.865547 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.865859 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.866173 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.866492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.866810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.867144 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.867505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.867928 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.868319 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.868654 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.869012 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.869328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.869678 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.870007 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.870323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.870638 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.870944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 00:31:40.871199 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 00:31:41.005945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO dbcounter [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Registered counter for database nova_api Aug 08 00:31:41.024449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO dbcounter [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Registered counter for database nova_api Aug 08 00:31:41.026502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_db.sqlalchemy.engines [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:31:41.033662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writer thread running {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:31:41.044534 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_db.sqlalchemy.engines [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:31:41.051493 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writer thread running {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:31:41.091232 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.context [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcec479f-7399-421c-8451-79722ed0a20d(cell1) {{(pid=130172) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 00:31:41.096172 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:31:41.096172 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:31:41.097806 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:31:41.098602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:31:41.099057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:31:41.101074 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:31:41.103101 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO dbcounter [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Registered counter for database nova_cell0 Aug 08 00:31:41.107247 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO dbcounter [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Registered counter for database nova_cell1 Aug 08 00:31:41.108944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.context [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcec479f-7399-421c-8451-79722ed0a20d(cell1) {{(pid=130173) load_cells /opt/stack/nova/nova/context.py:464}} Aug 08 00:31:41.113269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:31:41.113748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:31:41.114369 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_db.sqlalchemy.engines [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:31:41.115421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:31:41.116167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:31:41.116488 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_db.sqlalchemy.engines [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:31:41.116597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:31:41.118622 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:31:41.120810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO dbcounter [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Registered counter for database nova_cell0 Aug 08 00:31:41.124359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writer thread running {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:31:41.124998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO dbcounter [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Registered counter for database nova_cell1 Aug 08 00:31:41.127548 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writer thread running {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:31:41.132874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_db.sqlalchemy.engines [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:31:41.134618 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_db.sqlalchemy.engines [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:31:41.140771 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writer thread running {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:31:41.142614 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writer thread running {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:31:41.277382 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO dbcounter [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Registered counter for database nova_cell0 Aug 08 00:31:41.285109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_db.sqlalchemy.engines [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:31:41.288197 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO dbcounter [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Registered counter for database nova_cell0 Aug 08 00:31:41.289864 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writer thread running {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:31:41.296796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_db.sqlalchemy.engines [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 00:31:41.301503 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writer thread running {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 00:31:41.621764 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: WARNING keystonemiddleware.auth_token [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 00:31:41.624843 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: WARNING keystonemiddleware.auth_token [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 00:31:41.629747 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: WARNING keystonemiddleware.auth_token [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 00:31:41.632773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: WARNING keystonemiddleware.auth_token [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 00:31:41.974273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: WARNING keystonemiddleware.auth_token [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 00:31:41.980339 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: WARNING keystonemiddleware.auth_token [None req-a2dda5f2-1f0e-4f27-a392-a68aab501b14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 00:31:41.986752 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cdd36eb9c0 pid: 130173 (default app) Aug 08 00:31:41.993088 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: WARNING keystonemiddleware.auth_token [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 08 00:31:41.999038 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: WARNING keystonemiddleware.auth_token [None req-a719582d-f366-4491-92f1-f2c930e439a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 08 00:31:42.006025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cdd36eb9c0 pid: 130172 (default app) Aug 08 00:32:18.602165 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=3 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:18.603316 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=3 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:18.604043 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=3 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:18.604782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=3 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:19.542240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-226be441-6682-43a1-a7b2-ab88ec4fe280 tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] Action: 'create', calling method: .version_select at 0x7fd1a3fb6dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-790722670", "metadata": {"Type": "work"}}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:21.246758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-226be441-6682-43a1-a7b2-ab88ec4fe280 tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.657130 Aug 08 00:32:21.247721 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 8 00:32:18 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2660 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 00:32:21.272728 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=3 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:21.279281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=3 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:21.280220 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=3 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:21.281117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=3 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:21.538034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e7eb0936-0bcc-4ccf-b6bd-b07e1c2c685a tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] Calling method '.version_select at 0x7fd1a4025af0>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:22.176788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-df4f5f3c-9478-40b6-a36d-a007ff51e4a0 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3eaac10>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:22.480417 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e7eb0936-0bcc-4ccf-b6bd-b07e1c2c685a tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972" status: 200 len: 353 microversion: 2.1 time: 1.218203 Aug 08 00:32:22.480991 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:32:21 2022] GET /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972 => generated 353 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:32:22.495833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-def7f5e8-46a8-4a19-83bf-bb0a6d3dbd00 tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] Calling method '.version_select at 0x7fd1a3e6cc10>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:22.561230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-df4f5f3c-9478-40b6-a36d-a007ff51e4a0 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/d1b08bcd-e84d-40d1-ba11-f978a4ce3b22" status: 200 len: 350 microversion: 2.1 time: 0.524100 Aug 08 00:32:22.569624 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:32:22 2022] GET /compute/v2.1/os-volumes/d1b08bcd-e84d-40d1-ba11-f978a4ce3b22 => generated 350 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:22.678804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-def7f5e8-46a8-4a19-83bf-bb0a6d3dbd00 tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972" status: 200 len: 353 microversion: 2.1 time: 0.187742 Aug 08 00:32:22.679520 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:32:22 2022] GET /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972 => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:22.698676 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ed080e44-9eda-4bba-921c-22fc0ae8dc7e tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] Calling method '.version_select at 0x7fd1a3e473a0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:23.326856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ed080e44-9eda-4bba-921c-22fc0ae8dc7e tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972" status: 202 len: 0 microversion: 2.1 time: 0.632254 Aug 08 00:32:23.327673 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:32:22 2022] DELETE /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972 => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 00:32:23.336489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ed8fed38-cd32-434e-a57f-65acff034c1e tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] Calling method '.version_select at 0x7fd1a3e2d310>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:23.553102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ed8fed38-cd32-434e-a57f-65acff034c1e tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972" status: 200 len: 352 microversion: 2.1 time: 0.220534 Aug 08 00:32:23.560159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:32:23 2022] GET /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972 => generated 352 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:24.567881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9209f27b-d659-4949-95a0-ed4f642eb157 tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] Calling method '.version_select at 0x7fd1a3e47a60>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:24.618979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-9209f27b-d659-4949-95a0-ed4f642eb157 tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] HTTP exception thrown: Volume 7f887ed1-2673-4509-a074-de605b5db972 could not be found. Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9209f27b-d659-4949-95a0-ed4f642eb157 tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] Request method failure captured: Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972 HTTP/1.1 Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FmSPL7kUe0tteHFh9swNWzYtxMH0o1BYdbZUiVzwMN3cjYYBbgWrr8hfceei6BjUtgDi0qV6r7Sjt-cbpZrtRwrqquoBT1BwM65htV7kdzDIHEm6ekICPtrpqKRDYqc_cqCpH798GTbJMV1k1HNb7g6IkDJF_gRKWIbcZI6O40OW3s Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 970f6540da024352b1c05c8a1e570ad7 Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-VolumesGetTestJSON-1518603750 Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:32:24.623460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/970f6540da024352b1c05c8a1e570ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/970f6540da024352b1c05c8a1e570ad7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/970f6540da024352b1c05c8a1e570ad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_970f6540da024352b1c05c8a1e570ad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-VolumesGetTestJSON-1518603750 Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 970f6540da024352b1c05c8a1e570ad7 Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-VolumesGetTestJSON-1518603750 Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-VolumesGetTestJSON-1518603750-project Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: c6b912eaa21141d18ecc9b0a7b3adbb6 Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-VolumesGetTestJSON-1518603750-project Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Volume 7f887ed1-2673-4509-a074-de605b5db972 could not be found. Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '7f887ed1-2673-4509-a074-de605b5db972'} Aug 08 00:32:24.624669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f887ed1-2673-4509-a074-de605b5db972 could not be found. (HTTP 404) (Request-ID: req-351903b6-2760-494e-9b46-04de17496062) Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:24.625908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:32:24.626991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f887ed1-2673-4509-a074-de605b5db972 could not be found. Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 00:32:24.631139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f887ed1-2673-4509-a074-de605b5db972 could not be found. Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f887ed1-2673-4509-a074-de605b5db972 could not be found. Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9209f27b-d659-4949-95a0-ed4f642eb157 tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] Returning 404 to user: Volume 7f887ed1-2673-4509-a074-de605b5db972 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:32:24.634773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9209f27b-d659-4949-95a0-ed4f642eb157 tempest-VolumesGetTestJSON-1518603750 tempest-VolumesGetTestJSON-1518603750-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972" status: 404 len: 109 microversion: 2.1 time: 0.062516 Aug 08 00:32:24.642929 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:32:24 2022] GET /compute/v2.1/os-volumes/7f887ed1-2673-4509-a074-de605b5db972 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:32:25.395586 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-30f39532-7822-4066-a6c1-4696b4775dec tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3e2d9d0>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:25.516862 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-30f39532-7822-4066-a6c1-4696b4775dec tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e9bdf0d7-814d-4c31-9c17-6928ef2bd939" status: 200 len: 350 microversion: 2.1 time: 0.125304 Aug 08 00:32:25.519684 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:32:25 2022] GET /compute/v2.1/os-volumes/e9bdf0d7-814d-4c31-9c17-6928ef2bd939 => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:29.826065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-348303d6-fadc-4c27-9231-78737ada3741 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3dae430>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:29.955557 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-348303d6-fadc-4c27-9231-78737ada3741 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b28d31b9-7c26-42d9-b6fe-aa77b03f10bd" status: 200 len: 350 microversion: 2.1 time: 0.133079 Aug 08 00:32:29.962661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:32:29 2022] GET /compute/v2.1/os-volumes/b28d31b9-7c26-42d9-b6fe-aa77b03f10bd => generated 350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:29.978991 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-39ace024-0817-4588-b890-b92c47f60b35 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3e6caf0>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:30.216265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-39ace024-0817-4588-b890-b92c47f60b35 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.241205 Aug 08 00:32:30.216844 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 5/10] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Aug 8 00:32:29 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:30.231804 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f35bdee5-3da7-4d4d-81c0-4e3c28c210ad tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3daeaf0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:30.406707 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f35bdee5-3da7-4d4d-81c0-4e3c28c210ad tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.178771 Aug 08 00:32:30.408749 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1149 bytes} [Mon Aug 8 00:32:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:30.424689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-636bc0cc-b193-40ef-a44e-f17fc532dc2c tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3e6cf70>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:30.653281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-636bc0cc-b193-40ef-a44e-f17fc532dc2c tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.234530 Aug 08 00:32:30.654315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Aug 8 00:32:30 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:30.668971 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b937b1f9-7cc8-4c2f-ac31-f36792f0a591 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3dae1f0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:30.827338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b937b1f9-7cc8-4c2f-ac31-f36792f0a591 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.163675 Aug 08 00:32:30.828887 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1167 bytes} [Mon Aug 8 00:32:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:32:30.841768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-13f83c80-5b35-434e-b28f-d6cc3ee5b273 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3db4dc0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:31.193767 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-13f83c80-5b35-434e-b28f-d6cc3ee5b273 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.355586 Aug 08 00:32:31.202445 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1170 bytes} [Mon Aug 8 00:32:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:32:31.209389 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-592b5b24-54ff-4cb3-bfd1-7cd6216687f0 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3dbe040>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:31.418134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-592b5b24-54ff-4cb3-bfd1-7cd6216687f0 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.213382 Aug 08 00:32:31.430224 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 9/15] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Aug 8 00:32:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:31.453620 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-de27150c-e15b-47b3-9181-9117a39c2917 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3db4ee0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:31.600502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b970a3b3-f0a6-4aaa-a9ee-c5301f819dbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'create', calling method: .version_select at 0x7fd1a3e2de50>, body: {"keypair": {"name": "tempest-keypair-1345389577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZD54Mt05NXYNDyBfT3KyAaBBvUm/+s70N3omIUje8Eexf5gmqF8oyNkddd/tucj+rvDaMT9H/0ijovBNrRA/mJ46l7MYwGHQzDpjciDLtcDR4wGpj4uvYFNx4AAR1Aow=="}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:31.780083 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-b970a3b3-f0a6-4aaa-a9ee-c5301f819dbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Getting quotas for project 1aa84c8a680d49f8be48580c62c18889. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:32:31.802509 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-b970a3b3-f0a6-4aaa-a9ee-c5301f819dbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Getting quotas for user fcc8eeb749a5457f98492da99199528c and project 1aa84c8a680d49f8be48580c62c18889. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:32:32.034551 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-de27150c-e15b-47b3-9181-9117a39c2917 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.602901 Aug 08 00:32:32.035644 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 10/16] 10.222.0.15 () {58 vars in 1188 bytes} [Mon Aug 8 00:32:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:32.050903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cbde3fc7-8733-4b09-9e2a-e642aff1cd89 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] Calling method '.version_select at 0x7fd1a3daee50>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:32.119411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b970a3b3-f0a6-4aaa-a9ee-c5301f819dbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.336473 Aug 08 00:32:32.120239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 7/17] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Aug 8 00:32:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1339 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 08 00:32:32.433169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cbde3fc7-8733-4b09-9e2a-e642aff1cd89 tempest-VolumesTestJSON-41928775 tempest-VolumesTestJSON-41928775-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.387447 Aug 08 00:32:32.434417 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 11/18] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Aug 8 00:32:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:35.930643 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-247604381", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:36.161393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1690076167", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "networks": [{"uuid": "61fd3a5e-b6e8-4581-b720-db1567079b03"}]}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:36.191257 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] validate_networks() for [('39987f39-4c60-4c27-9f4f-c7657da06e51', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:32:36.446159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] validate_networks() for [('61fd3a5e-b6e8-4581-b720-db1567079b03', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:32:38.156823 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:32:38.164037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:32:38.164037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:32:38.164037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:32:38.164037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:32:38.173328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:38.174125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:38.174774 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:38.175765 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:38.176427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:38.177070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:38.211361 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Getting quotas for project 9bd235f1f9f44df4b2e3dbd0c05b3a83. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:32:38.215054 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Getting quotas for user c0aa06eea99f4011ab85ec51b0e60f2c and project 9bd235f1f9f44df4b2e3dbd0c05b3a83. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:32:38.228193 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:32:38.231574 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:32:38.429840 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-30ce3f35-e21e-4272-841c-68fb3fa4ee00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.914766 Aug 08 00:32:38.431796 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 8/19] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:32:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:32:38.445528 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-310f5ab2-7442-4700-82ba-89d5033851f7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:38.446337 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-310f5ab2-7442-4700-82ba-89d5033851f7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:38.610128 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-310f5ab2-7442-4700-82ba-89d5033851f7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:38.629967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-310f5ab2-7442-4700-82ba-89d5033851f7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1221 microversion: 2.1 time: 0.189312 Aug 08 00:32:38.630679 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 9/20] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:38 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:38.643520 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2047832774", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80d6d476-8f39-44d3-b747-4eed8b7c1a18"}], "security_groups": [{"name": "tempest-securitygroup--1482346910"}], "key_name": "tempest-keypair-1345389577", "user_data": "}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:38.794922 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] validate_networks() for [('80d6d476-8f39-44d3-b747-4eed8b7c1a18', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:32:39.254196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:32:39.254848 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:32:39.255389 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:32:39.255802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:32:39.256214 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:32:39.265028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:39.266427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:39.267164 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:39.270309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:39.270770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:39.271423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:39.298070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Getting quotas for project 1aa84c8a680d49f8be48580c62c18889. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:32:39.301750 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Getting quotas for user fcc8eeb749a5457f98492da99199528c and project 1aa84c8a680d49f8be48580c62c18889. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:32:39.313914 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:32:39.316671 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:32:39.391463 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:32:39.398679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:32:39.398679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:32:39.398679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:32:39.398679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:32:39.421064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:39.422078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:39.428768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:39.428768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:39.429998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:39.430597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:39.486889 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f5787460-b49e-4b70-a777-3ab582cc2e9d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.852768 Aug 08 00:32:39.491919 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 10/21] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Aug 8 00:32:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 00:32:39.492295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Getting quotas for project 7214cb5b7d4c4c949c84dc81601a89e0. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:32:39.501786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f2b30989-3d11-41af-b599-0313bada9536 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:39.504844 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f2b30989-3d11-41af-b599-0313bada9536 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:39.505746 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Getting quotas for user be18a802a38143518bb0bb79afaae011 and project 7214cb5b7d4c4c949c84dc81601a89e0. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:32:39.562135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:32:39.598099 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:32:39.682099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f2b30989-3d11-41af-b599-0313bada9536 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:39.682099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f2b30989-3d11-41af-b599-0313bada9536 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:39.683204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f2b30989-3d11-41af-b599-0313bada9536 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:39.683204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f2b30989-3d11-41af-b599-0313bada9536 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1282 microversion: 2.20 time: 0.185965 Aug 08 00:32:39.686107 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 11/22] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:39 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:32:39.692063 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-666783544", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:39.789772 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] validate_networks() for [('39987f39-4c60-4c27-9f4f-c7657da06e51', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:32:39.944217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-aa7b958f-2247-4742-b780-180c27db8207 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.957085 Aug 08 00:32:39.946055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 12/23] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:32:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:32:39.967624 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2af972de-31d8-4401-95a7-61d7c2dbf4ba tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:39.969490 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2af972de-31d8-4401-95a7-61d7c2dbf4ba tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:40.196546 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2af972de-31d8-4401-95a7-61d7c2dbf4ba tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:40.267446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2af972de-31d8-4401-95a7-61d7c2dbf4ba tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1215 microversion: 2.1 time: 0.307524 Aug 08 00:32:40.270899 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 13/24] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:39 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1215 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:40.706399 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a146dd55-8cca-4007-aad3-32992ca54159 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:40.707082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a146dd55-8cca-4007-aad3-32992ca54159 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:41.000702 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a146dd55-8cca-4007-aad3-32992ca54159 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:41.019110 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a146dd55-8cca-4007-aad3-32992ca54159 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:41.023204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a146dd55-8cca-4007-aad3-32992ca54159 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:41.028373 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a146dd55-8cca-4007-aad3-32992ca54159 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1282 microversion: 2.20 time: 0.324708 Aug 08 00:32:41.031628 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 14/25] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:40 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1282 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:41.181383 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:32:41.181951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:32:41.182537 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:32:41.183174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:32:41.184056 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:32:41.205749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:41.207005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:41.208827 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:41.214403 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:41.215072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:41.219330 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:41.296971 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0f686b72-c0d7-4aca-adb5-8c44c8d8e679 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:41.297550 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0f686b72-c0d7-4aca-adb5-8c44c8d8e679 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:41.304526 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Getting quotas for project 9bd235f1f9f44df4b2e3dbd0c05b3a83. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:32:41.320242 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Getting quotas for user c0aa06eea99f4011ab85ec51b0e60f2c and project 9bd235f1f9f44df4b2e3dbd0c05b3a83. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:32:41.378005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:32:41.385241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:32:41.426450 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0f686b72-c0d7-4aca-adb5-8c44c8d8e679 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:41.439792 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0f686b72-c0d7-4aca-adb5-8c44c8d8e679 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1215 microversion: 2.1 time: 0.147209 Aug 08 00:32:41.444767 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 15/26] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:41 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:41.621269 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4c7b3986-893f-42fb-8179-7d6d653d8b84 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.933879 Aug 08 00:32:41.621918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 12/27] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:32:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:32:41.635025 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-81ebbfdc-6968-451f-83bd-3428b809c0c6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:41.635176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-81ebbfdc-6968-451f-83bd-3428b809c0c6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:41.727572 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-81ebbfdc-6968-451f-83bd-3428b809c0c6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:41.741542 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-81ebbfdc-6968-451f-83bd-3428b809c0c6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1221 microversion: 2.1 time: 0.111164 Aug 08 00:32:41.742123 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 16/28] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:41 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:42.053981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:42.054923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:42.061837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:42.063172 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:42.070458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:42.070458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:42.070458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:42.070458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:42.250736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:42.265580 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:42.267079 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:42.268243 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-be192e59-1f12-44cd-a672-0fd78ba14705 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1286 microversion: 2.20 time: 0.219280 Aug 08 00:32:42.268796 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 13/29] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:42 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1286 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:42.460051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:42.460666 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:42.469491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:42.469981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:42.470423 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:42.471132 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:42.481425 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:42.481921 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:42.657891 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:42.665903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0df64f85-3b44-4eb1-acf9-eac91449bc8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1219 microversion: 2.1 time: 0.209823 Aug 08 00:32:42.666689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 17/30] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:42 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1219 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:42.761834 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a7932631-37f5-41e9-915f-7ceb208d2c3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:42.763125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a7932631-37f5-41e9-915f-7ceb208d2c3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:42.841821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a7932631-37f5-41e9-915f-7ceb208d2c3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:42.849488 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a7932631-37f5-41e9-915f-7ceb208d2c3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1221 microversion: 2.1 time: 0.091543 Aug 08 00:32:42.850894 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 14/31] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:42 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:32:43.290705 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:43.291467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:43.300365 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:43.301365 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:43.301823 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:43.302537 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:43.303959 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:43.304403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:43.396904 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:43.408162 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:43.408468 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:43.409769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a55cf094-117c-4491-8ebc-1e789cbf244a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1334 microversion: 2.20 time: 0.123683 Aug 08 00:32:43.410786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 18/32] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:43 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1334 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:43.689850 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:43.690529 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:43.700327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:43.700834 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:43.701457 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:43.702668 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:43.703336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:43.703921 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:43.786763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:43.794553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-837a6fe3-ae0f-48eb-82ae-ffaa3ad3a52c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1267 microversion: 2.1 time: 0.110144 Aug 08 00:32:43.795470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 15/33] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:43 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:43.870023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:43.870753 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:43.878159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:43.878907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:43.879389 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:43.880093 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:43.880544 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:43.880960 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:43.949421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:43.960811 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-396372ad-6b0d-4535-b48b-d475add6d5dd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1217 microversion: 2.1 time: 0.094541 Aug 08 00:32:43.974484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 19/34] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:43 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:44.434290 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:44.435617 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:44.442591 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:44.446577 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:44.447550 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:44.448610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:44.449375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:44.450073 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:44.641066 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-00df1de4-d613-41f2-9648-b74e779828db tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Action: 'create', calling method: .version_select at 0x7fd1a2436e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-329550462", "metadata": {"Type": "work"}}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-00df1de4-d613-41f2-9648-b74e779828db tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Request method failure captured: Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 121 Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fmsz7f2NTQmjt54AxpSA5L8a6omAHL1WmJpMcO6f9IiGQ6U9IE5-1QfGfSzUyU2QYUDx4pz4_LjAwgLEDVALzfGR3JFkwxT3M7eUx1dUnrXEIegfWVYwQQxSqkjaAQhYwb3cAPlyZWoekLYq8z2i17EXKDCojVNcOxNgeGmxLhpOBI Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:32:44.655159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: ed408d27ba5b46978e5afa4d4012d1c1 Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-329550462", "metadata": {"Type": "work"}}} Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: Aug 08 00:32:44.657144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-329550462', 'metadata': {'Type': 'work'}}}} Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise error Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi '#$%' Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:32:44.658110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 00:32:44.659653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 00:32:44.661476 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 08 00:32:44.661476 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.663348 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-00df1de4-d613-41f2-9648-b74e779828db tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:32:44.664221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-00df1de4-d613-41f2-9648-b74e779828db tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.387419 Aug 08 00:32:44.691412 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 16/35] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 8 00:32:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 398 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 00:32:44.692754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:44.692859 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b728d567-bc0d-46b7-bb05-d676e67c901c tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Action: 'create', calling method: .version_select at 0x7fd1a3563a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-673624563", "metadata": {"Type": "work"}}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:44.693274 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:44.694890 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:44.695901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2f9892ff-ce70-403d-a7b1-e78678ef6da3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1342 microversion: 2.20 time: 0.266687 Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b728d567-bc0d-46b7-bb05-d676e67c901c tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Request method failure captured: Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 119 Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fmsz7f2NTQmjt54AxpSA5L8a6omAHL1WmJpMcO6f9IiGQ6U9IE5-1QfGfSzUyU2QYUDx4pz4_LjAwgLEDVALzfGR3JFkwxT3M7eUx1dUnrXEIegfWVYwQQxSqkjaAQhYwb3cAPlyZWoekLYq8z2i17EXKDCojVNcOxNgeGmxLhpOBI Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:32:44.700085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: ed408d27ba5b46978e5afa4d4012d1c1 Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-673624563", "metadata": {"Type": "work"}}} Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: Aug 08 00:32:44.701205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-673624563', 'metadata': {'Type': 'work'}}}} Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise error Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi '0' Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:32:44.701898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 00:32:44.703125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 00:32:44.704120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 08 00:32:44.704120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.704255 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 20/36] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:44 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1342 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:32:44.709759 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b728d567-bc0d-46b7-bb05-d676e67c901c tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:32:44.710683 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b728d567-bc0d-46b7-bb05-d676e67c901c tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.031372 Aug 08 00:32:44.714580 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 17/37] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 8 00:32:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 00:32:44.728723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1b695df9-60b3-4d34-a3b5-b36af316a8dd tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Action: 'create', calling method: .version_select at 0x7fd1a2bbc8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1926410177", "metadata": {"Type": "work"}}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1b695df9-60b3-4d34-a3b5-b36af316a8dd tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Request method failure captured: Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 119 Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fmsz7f2NTQmjt54AxpSA5L8a6omAHL1WmJpMcO6f9IiGQ6U9IE5-1QfGfSzUyU2QYUDx4pz4_LjAwgLEDVALzfGR3JFkwxT3M7eUx1dUnrXEIegfWVYwQQxSqkjaAQhYwb3cAPlyZWoekLYq8z2i17EXKDCojVNcOxNgeGmxLhpOBI Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:32:44.753734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: ed408d27ba5b46978e5afa4d4012d1c1 Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1926410177", "metadata": {"Type": "work"}}} Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: Aug 08 00:32:44.755042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1926410177', 'metadata': {'Type': 'work'}}}} Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise error Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi '' Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:32:44.755881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 08 00:32:44.757211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 08 00:32:44.758448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 08 00:32:44.758448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.758448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1b695df9-60b3-4d34-a3b5-b36af316a8dd tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:32:44.758448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1b695df9-60b3-4d34-a3b5-b36af316a8dd tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035814 Aug 08 00:32:44.762923 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 21/38] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Aug 8 00:32:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 08 00:32:44.769018 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f7986f1e-0bcc-4458-bfa8-808e1e0f46f7 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Calling method '.version_select at 0x7fd1a249bc10>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:44.817772 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:44.819161 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:44.821422 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-f7986f1e-0bcc-4458-bfa8-808e1e0f46f7 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] HTTP exception thrown: Volume tempest-invalid-1724741803 could not be found. Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f7986f1e-0bcc-4458-bfa8-808e1e0f46f7 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Request method failure captured: Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1724741803 HTTP/1.1 Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fmsz7f2NTQmjt54AxpSA5L8a6omAHL1WmJpMcO6f9IiGQ6U9IE5-1QfGfSzUyU2QYUDx4pz4_LjAwgLEDVALzfGR3JFkwxT3M7eUx1dUnrXEIegfWVYwQQxSqkjaAQhYwb3cAPlyZWoekLYq8z2i17EXKDCojVNcOxNgeGmxLhpOBI Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:32:44.829482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: ed408d27ba5b46978e5afa4d4012d1c1 Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Volume tempest-invalid-1724741803 could not be found. Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'tempest-invalid-1724741803'} Aug 08 00:32:44.830701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1724741803 could not be found. (HTTP 404) (Request-ID: req-fa493325-305a-409c-99e1-60f7f8f1e49a) Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:44.839406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 00:32:44.840439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1724741803 could not be found. Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:32:44.841463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1724741803 could not be found. Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1724741803 could not be found. Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f7986f1e-0bcc-4458-bfa8-808e1e0f46f7 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Returning 404 to user: Volume tempest-invalid-1724741803 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:32:44.842493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f7986f1e-0bcc-4458-bfa8-808e1e0f46f7 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1724741803" status: 404 len: 99 microversion: 2.1 time: 0.068609 Aug 08 00:32:44.844918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:44.844918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:44.844918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:44.844918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:44.845233 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:44.845233 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:44.846090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 18/39] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 8 00:32:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1724741803 => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 08 00:32:44.870186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b92ac2ea-1f89-4fb4-9036-d0e20c3a233b tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022910 Aug 08 00:32:44.872650 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 19/40] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Aug 8 00:32:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 00:32:44.905662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-133f255f-0edf-49dc-9ca6-7a5fcb5ee109 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003710 Aug 08 00:32:44.906982 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 20/41] 10.222.0.15 () {58 vars in 1137 bytes} [Mon Aug 8 00:32:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 08 00:32:44.921644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-934ba78b-f70b-4831-a7e2-c21ddabe1f4c tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Calling method '.version_select at 0x7fd1a238c0d0>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:45.010742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-934ba78b-f70b-4831-a7e2-c21ddabe1f4c tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] HTTP exception thrown: Volume ca5fdccf-4e48-4910-9a34-c4316e2b1784 could not be found. Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-934ba78b-f70b-4831-a7e2-c21ddabe1f4c tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Request method failure captured: Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/os-volumes/ca5fdccf-4e48-4910-9a34-c4316e2b1784 HTTP/1.1 Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fmsz7f2NTQmjt54AxpSA5L8a6omAHL1WmJpMcO6f9IiGQ6U9IE5-1QfGfSzUyU2QYUDx4pz4_LjAwgLEDVALzfGR3JFkwxT3M7eUx1dUnrXEIegfWVYwQQxSqkjaAQhYwb3cAPlyZWoekLYq8z2i17EXKDCojVNcOxNgeGmxLhpOBI Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:32:45.012749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: ed408d27ba5b46978e5afa4d4012d1c1 Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Volume ca5fdccf-4e48-4910-9a34-c4316e2b1784 could not be found. Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'ca5fdccf-4e48-4910-9a34-c4316e2b1784'} Aug 08 00:32:45.021794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca5fdccf-4e48-4910-9a34-c4316e2b1784 could not be found. (HTTP 404) (Request-ID: req-c09b0c44-51a0-4d04-ae9c-dac7268bec26) Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:45.023508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 00:32:45.026644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca5fdccf-4e48-4910-9a34-c4316e2b1784 could not be found. Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 00:32:45.030049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca5fdccf-4e48-4910-9a34-c4316e2b1784 could not be found. Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca5fdccf-4e48-4910-9a34-c4316e2b1784 could not be found. Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-934ba78b-f70b-4831-a7e2-c21ddabe1f4c tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Returning 404 to user: Volume ca5fdccf-4e48-4910-9a34-c4316e2b1784 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-934ba78b-f70b-4831-a7e2-c21ddabe1f4c tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/ca5fdccf-4e48-4910-9a34-c4316e2b1784" status: 404 len: 109 microversion: 2.1 time: 0.101500 Aug 08 00:32:45.032565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:32:44 2022] DELETE /compute/v2.1/os-volumes/ca5fdccf-4e48-4910-9a34-c4316e2b1784 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:32:45.036591 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:45.036591 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:45.055349 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:45.063207 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:45.066961 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:45.067978 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:45.068476 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:45.068916 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:45.254336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:45.274423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-efd25629-2291-4a1c-aa09-c4b67ea0a8ef tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1273 microversion: 2.1 time: 0.249250 Aug 08 00:32:45.279077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:45 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:45.288255 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-463d78e2-3207-414d-92b6-6bf01ed571c4 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Calling method '.version_select at 0x7fd1a238ce50>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:45.375578 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-463d78e2-3207-414d-92b6-6bf01ed571c4 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] HTTP exception thrown: Volume 524adaa7-46c2-42c8-82fb-90add48091c4 could not be found. Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-463d78e2-3207-414d-92b6-6bf01ed571c4 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Request method failure captured: Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/os-volumes/524adaa7-46c2-42c8-82fb-90add48091c4 HTTP/1.1 Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fmsz7f2NTQmjt54AxpSA5L8a6omAHL1WmJpMcO6f9IiGQ6U9IE5-1QfGfSzUyU2QYUDx4pz4_LjAwgLEDVALzfGR3JFkwxT3M7eUx1dUnrXEIegfWVYwQQxSqkjaAQhYwb3cAPlyZWoekLYq8z2i17EXKDCojVNcOxNgeGmxLhpOBI Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:32:45.378052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_65fc9fdf93124d50b1c783a9271f1faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 65fc9fdf93124d50b1c783a9271f1faf Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesNegativeTest-2137018033 Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: ed408d27ba5b46978e5afa4d4012d1c1 Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesNegativeTest-2137018033-project Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Volume 524adaa7-46c2-42c8-82fb-90add48091c4 could not be found. Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '524adaa7-46c2-42c8-82fb-90add48091c4'} Aug 08 00:32:45.379186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 524adaa7-46c2-42c8-82fb-90add48091c4 could not be found. (HTTP 404) (Request-ID: req-198e66ca-e205-40eb-86e9-464804410a0a) Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:45.379874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:32:45.380804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 524adaa7-46c2-42c8-82fb-90add48091c4 could not be found. Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 00:32:45.381734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 524adaa7-46c2-42c8-82fb-90add48091c4 could not be found. Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 524adaa7-46c2-42c8-82fb-90add48091c4 could not be found. Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-463d78e2-3207-414d-92b6-6bf01ed571c4 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] Returning 404 to user: Volume 524adaa7-46c2-42c8-82fb-90add48091c4 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-463d78e2-3207-414d-92b6-6bf01ed571c4 tempest-VolumesNegativeTest-2137018033 tempest-VolumesNegativeTest-2137018033-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/524adaa7-46c2-42c8-82fb-90add48091c4" status: 404 len: 109 microversion: 2.1 time: 0.099159 Aug 08 00:32:45.382658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 23/44] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:32:45 2022] GET /compute/v2.1/os-volumes/524adaa7-46c2-42c8-82fb-90add48091c4 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:32:45.428323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:45.462513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-16dd0354-fc35-4b32-af0c-d4e32ef14447 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1285 microversion: 2.1 time: 0.648793 Aug 08 00:32:45.466588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 22/45] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:44 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1285 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:45.735012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:45.736357 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:45.753155 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:45.754619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:45.757761 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:45.759779 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:45.765796 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:45.765796 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:45.876216 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:45.893027 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:45.897228 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:45.898664 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f833c33f-6757-4b71-a7c6-dc3aad835a2e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1340 microversion: 2.20 time: 0.175914 Aug 08 00:32:45.907045 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:45 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1340 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:46.296111 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:46.297556 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:46.304840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:46.305609 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:46.319706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:46.321572 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:46.322648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:46.324758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:46.489144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:46.490712 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:46.503743 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:46.503743 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:46.503743 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:46.503743 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:46.504025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:46.504025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:46.537436 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:46.562973 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-80b116cf-2a19-4907-a5d2-7423fd2fe130 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1279 microversion: 2.1 time: 0.268703 Aug 08 00:32:46.584964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 23/47] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:46 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1279 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:46.928092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:46.929553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:46.943749 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:46.944555 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:46.945923 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:46.947433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:46.949558 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:46.950218 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:47.048090 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:47.062650 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:47.066122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:47.073487 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1ea8b70f-e531-446a-a35e-3ea7cd1a522f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1340 microversion: 2.20 time: 0.150656 Aug 08 00:32:47.074400 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 24/48] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:46 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1340 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:47.131123 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:47.156527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7a09ca35-497f-4d39-a8d0-aa699300f20f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.672585 Aug 08 00:32:47.187351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 25/49] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:46 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:47.591587 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:47.592204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:47.600144 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:47.600837 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:47.610585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:47.614152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:47.616894 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:47.619697 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:48.013547 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:48.046622 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a9a6f5a9-3c74-4e81-99af-20b8be34b50d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.448230 Aug 08 00:32:48.059825 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:47 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:48.100873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:48.101612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:48.127411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:48.131831 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:48.136301 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:48.138816 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:48.142576 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:48.145408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:48.201887 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:48.202849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:48.222935 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:48.231443 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:48.234314 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:48.235800 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:48.240914 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:48.243286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:49.109232 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:49.120354 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:49.126590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:49.137803 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-34f66d51-b7c2-4cab-9d4b-d9af4432f35a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 1.035693 Aug 08 00:32:49.137803 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 26/51] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:48 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:49.144931 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:49.145557 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:49.163138 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:49.166282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:49.168661 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:49.169609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:49.173398 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:49.174116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:49.512481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:49.512481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b48a8de6-0876-46c9-8fa3-eaa8e34a1227 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 1.261143 Aug 08 00:32:49.512481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 26/52] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:48 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:49.581022 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:49.597991 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-00508716-2687-4258-9644-6f4fb628d6b6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.461655 Aug 08 00:32:49.599266 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:49 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:50.162414 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:50.162576 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:50.164693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:50.172553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:50.179510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:50.179975 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:50.180720 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:50.183347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:50.184748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:50.525896 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:50.526554 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:50.534929 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:50.539654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:50.541513 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:50.541513 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:50.541757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:50.542328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:50.556888 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:50.570241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:50.581148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:50.582421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ccc9eece-7d68-4bb8-aaa3-5a0235fdb74b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.424980 Aug 08 00:32:50.588273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 27/54] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:50 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:50.626913 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:50.628027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:50.661674 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:50.662123 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:50.662733 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:50.663558 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:50.664075 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:50.664428 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:51.088084 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:51.101001 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-912819e9-5c4f-413d-99ba-679c7082c9c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.478167 Aug 08 00:32:51.102362 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 28/55] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:50 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:51.217542 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:51.245414 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-27f9f2e0-ced2-4d71-bb0f-b3e1cc732b0a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.722359 Aug 08 00:32:51.248919 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 28/56] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:50 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:32:51.491215 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:51.545195 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-d1e83df4-7ec7-4893-bc22-d55b7d230edd req-278ba083-a30b-4f9b-b5e2-cd94def483cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127db5f0-f5b7-4e93-889a-603eae1f3e3d", "tag": "f3753ab8-b02b-4899-add3-0636f7b130d3"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:51.568290 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-d1e83df4-7ec7-4893-bc22-d55b7d230edd req-278ba083-a30b-4f9b-b5e2-cd94def483cb service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:51.568898 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-d1e83df4-7ec7-4893-bc22-d55b7d230edd req-278ba083-a30b-4f9b-b5e2-cd94def483cb service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:51.569338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-d1e83df4-7ec7-4893-bc22-d55b7d230edd req-278ba083-a30b-4f9b-b5e2-cd94def483cb service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:51.593541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-d1e83df4-7ec7-4893-bc22-d55b7d230edd req-278ba083-a30b-4f9b-b5e2-cd94def483cb service nova] Creating event network-changed:f3753ab8-b02b-4899-add3-0636f7b130d3 for instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d on hv-cinder-85164 Aug 08 00:32:51.594336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-d1e83df4-7ec7-4893-bc22-d55b7d230edd req-278ba083-a30b-4f9b-b5e2-cd94def483cb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130173) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 00:32:51.594829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-d1e83df4-7ec7-4893-bc22-d55b7d230edd req-278ba083-a30b-4f9b-b5e2-cd94def483cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=130173) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 00:32:51.596081 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a81b2490-164a-4f72-becf-23b81588b009 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:51.596619 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a81b2490-164a-4f72-becf-23b81588b009 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:51.596945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a81b2490-164a-4f72-becf-23b81588b009 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:51.597646 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a81b2490-164a-4f72-becf-23b81588b009 None None] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:51.598247 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a81b2490-164a-4f72-becf-23b81588b009 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:51.598891 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a81b2490-164a-4f72-becf-23b81588b009 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:51.608446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.compute.rpcapi [None req-a81b2490-164a-4f72-becf-23b81588b009 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 00:32:51.609353 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a81b2490-164a-4f72-becf-23b81588b009 None None] Releasing lock "compute-rpcapi-router" {{(pid=130173) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 00:32:51.629484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a81b2490-164a-4f72-becf-23b81588b009 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278332 Aug 08 00:32:51.629484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 29/57] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:51.633945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:51.634704 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:51.641978 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:51.643423 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:51.643423 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:51.643755 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:51.644203 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:51.644621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:51.652945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-723fb3e4-0490-4dcb-9dbc-ac9f5e3cfb01 req-55e6494c-69e6-4649-82de-8f3dafa59c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8968cf66-c321-4187-8166-47cdc6cc701e", "tag": "04d4459b-df65-4f20-b895-eaa736bf1d79"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:51.666964 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-723fb3e4-0490-4dcb-9dbc-ac9f5e3cfb01 req-55e6494c-69e6-4649-82de-8f3dafa59c77 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:51.667472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-723fb3e4-0490-4dcb-9dbc-ac9f5e3cfb01 req-55e6494c-69e6-4649-82de-8f3dafa59c77 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:51.667905 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-723fb3e4-0490-4dcb-9dbc-ac9f5e3cfb01 req-55e6494c-69e6-4649-82de-8f3dafa59c77 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:51.688883 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-723fb3e4-0490-4dcb-9dbc-ac9f5e3cfb01 req-55e6494c-69e6-4649-82de-8f3dafa59c77 service nova] Creating event network-changed:04d4459b-df65-4f20-b895-eaa736bf1d79 for instance 8968cf66-c321-4187-8166-47cdc6cc701e on hv-cinder-85164 Aug 08 00:32:51.690100 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-723fb3e4-0490-4dcb-9dbc-ac9f5e3cfb01 req-55e6494c-69e6-4649-82de-8f3dafa59c77 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130172) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 08 00:32:51.690681 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-723fb3e4-0490-4dcb-9dbc-ac9f5e3cfb01 req-55e6494c-69e6-4649-82de-8f3dafa59c77 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130172) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 08 00:32:51.691877 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cfecdfc-9dc9-4130-be03-407822547db4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:51.692411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cfecdfc-9dc9-4130-be03-407822547db4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:51.692935 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cfecdfc-9dc9-4130-be03-407822547db4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:51.693726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cfecdfc-9dc9-4130-be03-407822547db4 None None] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:51.694243 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cfecdfc-9dc9-4130-be03-407822547db4 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:51.694682 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cfecdfc-9dc9-4130-be03-407822547db4 None None] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:51.704271 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.compute.rpcapi [None req-0cfecdfc-9dc9-4130-be03-407822547db4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 08 00:32:51.705153 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cfecdfc-9dc9-4130-be03-407822547db4 None None] Releasing lock "compute-rpcapi-router" {{(pid=130172) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 08 00:32:51.732922 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=14 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:51.733293 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0cfecdfc-9dc9-4130-be03-407822547db4 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251132 Aug 08 00:32:51.735250 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 29/58] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:51.828034 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:51.838445 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:51.848590 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:51.850062 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1067832d-567a-46ab-9c0d-e4251fd3616f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.220653 Aug 08 00:32:51.851306 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 30/59] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:51 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:52.123728 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:52.125240 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:52.136338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:52.136338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:52.136338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:52.136338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:52.136656 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:52.143363 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:52.146281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:52.276187 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:52.276795 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:52.285029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:52.287166 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:52.287783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:52.289646 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:52.291535 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:52.292327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:52.337576 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:52.349790 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5c591e1a-3334-4c02-b92d-61ef1e188bbe tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.230524 Aug 08 00:32:52.351909 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 30/60] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:52 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:52.483415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:52.491799 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-71f10fd9-a30e-4750-b710-2a0c93adabb2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.219473 Aug 08 00:32:52.492369 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 31/61] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:52 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:52.874234 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:52.874998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:52.880361 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=28 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:52.882241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:52.882900 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:52.883712 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:52.884585 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:52.885190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:52.885891 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:53.111920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:53.121606 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:53.124499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:53.125865 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-852e27eb-21ea-4dcf-ae3d-da31488b5326 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.255682 Aug 08 00:32:53.148487 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 31/62] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:52 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:53.373161 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:53.373787 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:53.380541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:53.381027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:53.381460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:53.382172 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:53.382619 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:53.383041 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:53.513874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:53.514489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:53.524791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:53.525305 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:53.525739 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:53.532696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:53.533195 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:53.533638 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:53.543788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:53.556835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-022a1ed7-388e-4073-8175-d74455bdd88c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.186894 Aug 08 00:32:53.557674 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 32/63] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:53 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:53.651241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-12847798-4dd8-442d-9325-29010a18eea6 req-dcc1b255-5e71-420b-b78e-28382b541a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8480cf-4061-4c55-8118-a74951cf6142", "tag": "247bdc76-37cc-4751-82b6-e4aaca65e313"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:53.689382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-12847798-4dd8-442d-9325-29010a18eea6 req-dcc1b255-5e71-420b-b78e-28382b541a81 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:53.689382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-12847798-4dd8-442d-9325-29010a18eea6 req-dcc1b255-5e71-420b-b78e-28382b541a81 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:53.689382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-12847798-4dd8-442d-9325-29010a18eea6 req-dcc1b255-5e71-420b-b78e-28382b541a81 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:53.741065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-12847798-4dd8-442d-9325-29010a18eea6 req-dcc1b255-5e71-420b-b78e-28382b541a81 service nova] Creating event network-changed:247bdc76-37cc-4751-82b6-e4aaca65e313 for instance 9f8480cf-4061-4c55-8118-a74951cf6142 on hv-cinder-85164 Aug 08 00:32:53.755398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-12847798-4dd8-442d-9325-29010a18eea6 req-dcc1b255-5e71-420b-b78e-28382b541a81 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108069 Aug 08 00:32:53.756475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 33/64] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:53.761621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-25177a6e-722e-4512-949a-cb048d816ace req-14d4dd66-3f98-4c15-befb-fbbb06a3d636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4829f58c-adec-413d-83c8-23f1d3143205", "tag": "424b2123-2ed7-4eda-bdcf-dd72a3df7bea"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:32:53.772927 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-25177a6e-722e-4512-949a-cb048d816ace req-14d4dd66-3f98-4c15-befb-fbbb06a3d636 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:53.774897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-25177a6e-722e-4512-949a-cb048d816ace req-14d4dd66-3f98-4c15-befb-fbbb06a3d636 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:53.774897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-25177a6e-722e-4512-949a-cb048d816ace req-14d4dd66-3f98-4c15-befb-fbbb06a3d636 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:53.794585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-25177a6e-722e-4512-949a-cb048d816ace req-14d4dd66-3f98-4c15-befb-fbbb06a3d636 service nova] Creating event network-changed:424b2123-2ed7-4eda-bdcf-dd72a3df7bea for instance 4829f58c-adec-413d-83c8-23f1d3143205 on hv-cinder-85164 Aug 08 00:32:53.813449 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:53.819565 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-25177a6e-722e-4512-949a-cb048d816ace req-14d4dd66-3f98-4c15-befb-fbbb06a3d636 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061025 Aug 08 00:32:53.821195 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 34/65] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:32:53.829213 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2581fa24-409c-44a5-ab0d-138491b771fc tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.319041 Aug 08 00:32:53.831365 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 32/66] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:53 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:32:54.156736 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:54.157944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:54.165171 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:54.166031 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:54.166534 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:54.167393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:54.167917 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:54.168408 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:54.366457 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:54.381844 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=100 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:54.385649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:54.390831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:54.390831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-82321ae3-0b5c-4772-8942-cc76ffc48fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.236892 Aug 08 00:32:54.390831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 35/67] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:54 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:54.578955 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:54.579680 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:54.585778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:54.586329 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:54.586755 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:54.587486 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:54.587939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:54.588358 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:54.851370 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:54.851977 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:54.858400 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:54.859549 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:54.859998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:54.871684 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:54.872167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:54.872613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:54.881597 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:54.894012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2a79d552-6cf5-4309-b0a1-1ec69734e5b8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.318818 Aug 08 00:32:54.902779 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 33/68] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:54 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:55.125381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:55.133372 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4cce168b-a494-404a-806e-4c6db3a3dc8f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.286582 Aug 08 00:32:55.133987 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 36/69] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:54 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:55.424640 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:55.425262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:55.439267 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:55.439762 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:55.440195 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:55.441082 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:55.441533 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:55.441979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:55.670525 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:55.694807 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:55.826618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:55.826618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-879e56a7-f7c7-4649-8362-d380852d64c3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.290369 Aug 08 00:32:55.826618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 34/70] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:55 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:55.929397 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:55.930759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:55.937975 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:55.938461 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:55.938891 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:55.939621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:55.940074 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:55.940648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:56.158805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:56.160951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:56.166478 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:56.172453 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:56.173242 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:56.173804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:56.174638 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:56.175243 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:56.179890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:56.187649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-63b45120-ba3a-44a0-90fc-6038a561e770 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.259136 Aug 08 00:32:56.187649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 37/71] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:55 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:56.434270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:56.459514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6b9879e9-6ad4-429d-bd00-b622924d2494 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.307343 Aug 08 00:32:56.460128 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 35/72] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:56 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:56.723496 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:56.724309 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:56.733527 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:56.736207 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:56.744340 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:56.744340 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:56.744340 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:56.744340 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:56.988558 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:56.996613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:56.998482 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:57.000114 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6ac9ea4f-aff2-4a11-a3a8-4fb7f3b5fa8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.280973 Aug 08 00:32:57.000748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 38/73] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:56 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:57.206072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:57.206716 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:57.212960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:57.213437 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:57.213875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:57.214569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:57.215020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:57.215542 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:57.448684 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:57.454802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=100 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:32:57.463204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ef12eae3-d162-4080-829e-55c02687702f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.260901 Aug 08 00:32:57.469517 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 36/74] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:57 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:57.503792 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:57.504500 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:57.514595 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:57.518978 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:57.519450 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:57.523812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:57.523812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:57.523812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:57.726725 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:57.735141 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-878d1ea9-b737-4d35-ae9c-85d1501833b0 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.237246 Aug 08 00:32:57.749722 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 39/75] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:57 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:58.026853 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:58.027733 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:58.050143 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:58.054080 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:58.055120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:58.058106 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:58.061608 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:58.065391 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:58.487958 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:58.489381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:58.498406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:58.499289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:58.500077 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:58.501033 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:58.502457 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:58.503103 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:59.147951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:59.162266 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-715b94c0-1c51-415f-9970-6fac0c687f01 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.679526 Aug 08 00:32:59.162905 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 40/76] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:58 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:32:59.178907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:32:59.179551 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:32:59.192401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:59.195685 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:59.201195 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:59.202284 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:32:59.203488 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:32:59.204262 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:32:59.250403 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:59.267061 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:59.277146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:59.283809 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c91ca2f0-aa72-471b-9eb6-ddf5aa32b581 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 1.260597 Aug 08 00:32:59.287553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 37/77] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:32:58 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:32:59.709681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:32:59.717203 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ebdd0c96-f314-4062-9990-15a3d8f243e5 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.553189 Aug 08 00:32:59.718363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 41/78] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:32:59 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:00.190717 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:00.191578 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:00.206950 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:00.209076 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:00.210140 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:00.214972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:00.214972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:00.214972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:00.313745 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:00.314351 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:00.316341 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:00.323826 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:00.324559 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:00.324987 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:00.325841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:00.326483 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:00.327129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:00.388465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:00.397495 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a8e3c1d7-2159-4a38-96c9-2c8ba2ef96ee tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.212431 Aug 08 00:33:00.398293 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 38/79] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:00 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:00.566360 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:00.575307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:00.577024 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:00.578187 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-73339760-2308-48c8-b367-1f4a92035c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.268954 Aug 08 00:33:00.578744 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 42/80] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:33:00 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:33:00.745412 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:00.746739 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:00.755390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:00.756332 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:00.756911 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:00.757758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:00.758348 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:00.759014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:00.921037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:00.929594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2aa988c1-3bc6-4aff-924f-1dcb9923dc5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.189616 Aug 08 00:33:00.939985 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 39/81] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:00 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:01.420768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:01.421606 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:01.428777 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:01.429275 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:01.429742 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:01.430477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:01.430937 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:01.431469 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:01.604864 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:01.606304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:01.606797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:01.616516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:01.617231 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:01.618514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:01.619539 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:01.620443 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:01.620883 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:01.622775 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:01.632724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-84a67c87-a2d1-4918-8b47-a1ce9e4c3311 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.215912 Aug 08 00:33:01.641097 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 43/82] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:01 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:01.820315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:01.830410 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:01.832073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:01.833192 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-78e67f78-c43d-45c0-ad4f-13bbafdc8338 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.233212 Aug 08 00:33:01.834255 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 40/83] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:33:01 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:33:01.958324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:01.959183 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:01.965545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:01.966127 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:01.966557 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:01.971386 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:01.971386 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:01.971386 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:02.114536 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:02.125758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5c67c001-2aaa-41a5-a09f-5a24b00dfe5b tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.171066 Aug 08 00:33:02.127400 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 44/84] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:01 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:02.660875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:02.662154 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:02.664465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:02.676026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:02.676513 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:02.677259 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:02.678201 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:02.678886 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:02.679416 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:02.862569 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:02.864279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:02.865648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:02.873522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:02.875682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:02.878709 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:02.878709 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:02.878709 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:02.878709 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:02.879055 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f38cde40-ae39-4184-8da4-1770c119ad49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.221733 Aug 08 00:33:02.879864 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 41/85] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:02 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:03.026682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:03.035742 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:03.037250 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:03.038353 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9507870a-d098-4742-9b30-d74cf094dbbf tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.183163 Aug 08 00:33:03.038915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 45/86] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:33:02 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:33:03.150459 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:03.151146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:03.177056 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:03.177547 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:03.178041 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:03.178749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:03.179196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:03.179986 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:03.437986 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:03.454041 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-15824c12-6d92-4ac6-bf5f-8c629474caa9 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.310922 Aug 08 00:33:03.455123 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 42/87] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:03 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:03.904792 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:03.906196 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:03.914630 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:03.915122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:03.915583 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:03.916989 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:03.917451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:03.917880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:04.068311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:04.068311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:04.072806 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:04.073799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:04.074458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:04.075642 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:04.076176 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:04.076670 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:04.138179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:04.149237 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1137a9ae-48c7-497f-9de9-8db5855f983e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.248459 Aug 08 00:33:04.149237 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 46/88] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:03 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:04.310882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:04.326445 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:04.326445 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:04.326445 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a7aaa474-2453-4e79-8f0a-09e7e8956ee2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.264652 Aug 08 00:33:04.326706 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 43/89] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:33:04 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:33:04.488673 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:04.489306 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:04.495398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:04.495886 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:04.496319 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:04.497023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:04.497436 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:04.498336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:04.651692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:04.661156 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-26181c27-a07b-4be8-ad63-183cec9c3a6e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.176169 Aug 08 00:33:04.661753 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 47/90] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:04 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:05.168382 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:05.169002 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:05.176173 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:05.176602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:05.177040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:05.178044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:05.181746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:05.181746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:05.327783 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:05.335953 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-91a22f67-cabf-433a-9507-b1b9857f6c27 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.171754 Aug 08 00:33:05.343912 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 44/91] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:05 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:05.348665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:05.349418 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:05.355723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:05.373724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:05.373724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:05.373724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:05.373724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:05.374918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:05.511857 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:05.521916 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:05.524675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:05.524920 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-178bf1e0-a2df-4e08-8532-f617c93bcdab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.179871 Aug 08 00:33:05.525642 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 48/92] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:33:05 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:33:05.682546 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:05.696369 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:05.696369 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:05.696369 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:05.696369 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:05.697319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:05.697319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:05.697319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:05.853658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:05.861519 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-030310f2-1c51-4466-ae88-c2d8835c4f8d tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.182875 Aug 08 00:33:05.862175 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 45/93] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:05 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:06.359708 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:06.359708 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:06.375893 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:06.375893 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:06.375893 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:06.375893 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:06.376193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:06.376193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:06.549022 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:06.549704 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:06.555819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:06.565553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:06.580223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:06.580223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:06.580445 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:06.581796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:06.585325 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:06.591119 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a6dea8c4-d709-4f41-a16d-975e6cdcec06 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.237063 Aug 08 00:33:06.605855 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 49/94] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:06 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:06.834697 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:06.844449 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:06.846792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:06.848012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1efd2376-4d4a-444f-b277-c10fe68db773 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.303728 Aug 08 00:33:06.848563 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 46/95] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:33:06 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:33:06.852169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-bd7f34c5-715a-4335-9a65-cefb66c4c00b req-297bb08f-32e7-4ca6-86df-cc4e0bbf6d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4829f58c-adec-413d-83c8-23f1d3143205", "name": "network-vif-plugged", "status": "completed", "tag": "424b2123-2ed7-4eda-bdcf-dd72a3df7bea"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:06.866481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-bd7f34c5-715a-4335-9a65-cefb66c4c00b req-297bb08f-32e7-4ca6-86df-cc4e0bbf6d17 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:06.867029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-bd7f34c5-715a-4335-9a65-cefb66c4c00b req-297bb08f-32e7-4ca6-86df-cc4e0bbf6d17 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:06.867739 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-bd7f34c5-715a-4335-9a65-cefb66c4c00b req-297bb08f-32e7-4ca6-86df-cc4e0bbf6d17 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:06.881075 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-bd7f34c5-715a-4335-9a65-cefb66c4c00b req-297bb08f-32e7-4ca6-86df-cc4e0bbf6d17 service nova] Creating event network-vif-plugged:424b2123-2ed7-4eda-bdcf-dd72a3df7bea for instance 4829f58c-adec-413d-83c8-23f1d3143205 on hv-cinder-85164 Aug 08 00:33:06.885631 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:06.886922 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-bd7f34c5-715a-4335-9a65-cefb66c4c00b req-297bb08f-32e7-4ca6-86df-cc4e0bbf6d17 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121687 Aug 08 00:33:06.887045 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:06.893673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:06.894111 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:06.894300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 50/96] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:33:06.894681 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:06.895738 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:06.896607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:06.897202 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:07.050740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:07.058359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a8e084c7-de9b-4a46-9f6e-05c6ea477bcf tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.178066 Aug 08 00:33:07.062225 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 47/97] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:06 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:07.614767 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:07.616727 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:07.624162 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:07.624842 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:07.625851 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:07.627166 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:07.627783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:07.628422 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:07.820082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:07.828122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-87f609cd-37c5-40f3-87b4-93c3e486e88b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.218272 Aug 08 00:33:07.828771 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 51/98] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:07 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:07.873077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:07.873746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:07.881150 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:07.881745 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:07.882190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:07.882899 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:07.883385 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:07.883885 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:08.054391 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:08.063651 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:08.065163 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:08.066307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fc1cf0fc-de9b-4ee6-b0d1-efd5235851be tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.198476 Aug 08 00:33:08.067193 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 48/99] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:33:07 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:33:08.080096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:08.080706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:08.088761 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:08.098541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:08.098541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:08.098541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:08.098541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:08.099429 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:08.231205 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:08.252839 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-af83c0d2-f555-4d23-a214-234c8240b378 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.176798 Aug 08 00:33:08.253554 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 52/100] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:08 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:08.850094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:08.850703 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:08.856713 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:08.857240 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:08.857673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:08.858358 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:08.858809 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:08.859366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:08.908529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-bad5b964-1ed4-4f82-a519-12ca727fc5f0 req-73d4ea53-0109-49bf-8f60-73beae916083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8480cf-4061-4c55-8118-a74951cf6142", "name": "network-vif-plugged", "status": "completed", "tag": "247bdc76-37cc-4751-82b6-e4aaca65e313"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:08.918812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-bad5b964-1ed4-4f82-a519-12ca727fc5f0 req-73d4ea53-0109-49bf-8f60-73beae916083 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:08.919567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-bad5b964-1ed4-4f82-a519-12ca727fc5f0 req-73d4ea53-0109-49bf-8f60-73beae916083 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:08.919993 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-bad5b964-1ed4-4f82-a519-12ca727fc5f0 req-73d4ea53-0109-49bf-8f60-73beae916083 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:08.924402 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=100 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:08.933887 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-bad5b964-1ed4-4f82-a519-12ca727fc5f0 req-73d4ea53-0109-49bf-8f60-73beae916083 service nova] Creating event network-vif-plugged:247bdc76-37cc-4751-82b6-e4aaca65e313 for instance 9f8480cf-4061-4c55-8118-a74951cf6142 on hv-cinder-85164 Aug 08 00:33:08.941158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-bad5b964-1ed4-4f82-a519-12ca727fc5f0 req-73d4ea53-0109-49bf-8f60-73beae916083 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037208 Aug 08 00:33:08.943348 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 53/101] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:33:09.035090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:09.046858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f01f4f51-c815-471f-b935-eb6b0bedb014 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.197656 Aug 08 00:33:09.046858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 49/102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:08 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:09.090592 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:09.091319 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:09.104392 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:09.104392 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:09.104392 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:09.104392 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:09.104723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:09.104723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:09.273730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:09.275259 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:09.283346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:09.284248 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:09.284842 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:09.297158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:09.298979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:09.299607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:09.448399 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:09.456944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:09.487721 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:09.489754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d42031ce-50fb-40c2-b33e-b90e35ad1d39 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1408 microversion: 2.20 time: 0.403551 Aug 08 00:33:09.490345 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 54/103] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:33:09 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:33:09.530131 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:09.539324 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-618e7a5a-874f-4df5-8727-c3d41994187e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.269466 Aug 08 00:33:09.539905 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 50/104] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:09 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:10.066617 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:10.067249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:10.073733 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:10.074403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:10.075095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:10.075822 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:10.076276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:10.076706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:10.225924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:10.231001 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ddde0475-72df-4f4b-b301-79940ca26082 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.168254 Aug 08 00:33:10.231582 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 55/105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:10 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:10.515360 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:10.515960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:10.521792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:10.522368 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:10.522852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:10.523507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:10.523953 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:10.524382 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:10.559543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:10.560180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:10.566438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:10.566918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:10.567379 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:10.568076 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:10.568524 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:10.568959 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:10.659881 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:10.674294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:10.675943 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:10.677136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-061f64f9-2b07-45b4-985b-783bacd8a323 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1600 microversion: 2.20 time: 0.165724 Aug 08 00:33:10.677696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 51/106] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:33:10 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:33:10.700503 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-100c3563-1adb-4bbb-ab43-a118af51ec43 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:10.701002 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-100c3563-1adb-4bbb-ab43-a118af51ec43 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:10.707858 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:10.708284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-100c3563-1adb-4bbb-ab43-a118af51ec43 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:10.709034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-100c3563-1adb-4bbb-ab43-a118af51ec43 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:10.709471 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-100c3563-1adb-4bbb-ab43-a118af51ec43 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:10.710177 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-100c3563-1adb-4bbb-ab43-a118af51ec43 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:10.710632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-100c3563-1adb-4bbb-ab43-a118af51ec43 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:10.711058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-100c3563-1adb-4bbb-ab43-a118af51ec43 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:10.715656 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-51ad9a59-2ff8-4a11-8c37-bb2750743263 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.159782 Aug 08 00:33:10.716228 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 56/107] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:10 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:10.833595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-100c3563-1adb-4bbb-ab43-a118af51ec43 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.137168 Aug 08 00:33:10.834469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 52/108] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Aug 8 00:33:10 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 00:33:10.959610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-b591f0ba-5c0e-44cb-9ad8-76292bbfb95d req-18d41672-b120-47e5-a831-5b6bfabd40d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127db5f0-f5b7-4e93-889a-603eae1f3e3d", "name": "network-vif-plugged", "status": "completed", "tag": "f3753ab8-b02b-4899-add3-0636f7b130d3"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:10.987985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b591f0ba-5c0e-44cb-9ad8-76292bbfb95d req-18d41672-b120-47e5-a831-5b6bfabd40d1 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:10.988610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b591f0ba-5c0e-44cb-9ad8-76292bbfb95d req-18d41672-b120-47e5-a831-5b6bfabd40d1 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:10.989411 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b591f0ba-5c0e-44cb-9ad8-76292bbfb95d req-18d41672-b120-47e5-a831-5b6bfabd40d1 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:11.002514 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-b591f0ba-5c0e-44cb-9ad8-76292bbfb95d req-18d41672-b120-47e5-a831-5b6bfabd40d1 service nova] Creating event network-vif-plugged:f3753ab8-b02b-4899-add3-0636f7b130d3 for instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d on hv-cinder-85164 Aug 08 00:33:11.008037 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-b591f0ba-5c0e-44cb-9ad8-76292bbfb95d req-18d41672-b120-47e5-a831-5b6bfabd40d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055238 Aug 08 00:33:11.008750 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 57/109] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:33:11.255022 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:11.259041 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:11.267188 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:11.267723 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:11.268221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:11.269501 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:11.270115 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:11.271545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:11.737994 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:11.738701 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:11.745298 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:11.745831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:11.746269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:11.747037 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:11.747567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:11.748108 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:11.801350 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:11.810066 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=100 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:11.813031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-94500152-ccc7-424e-88a7-3309f8d0659b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.564384 Aug 08 00:33:11.814875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 53/110] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:11 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:11.897741 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:11.905737 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-16c98f60-dadc-415a-ab62-2727db55cdef tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.172087 Aug 08 00:33:11.906307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 58/111] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:11 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:12.363714 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-d276d805-9384-483c-89b2-8b15aae9b87e req-936c0522-9b68-4b1c-8224-8e30ed3ffe6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4829f58c-adec-413d-83c8-23f1d3143205", "tag": "424b2123-2ed7-4eda-bdcf-dd72a3df7bea"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:12.373617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-d276d805-9384-483c-89b2-8b15aae9b87e req-936c0522-9b68-4b1c-8224-8e30ed3ffe6e service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:12.374178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-d276d805-9384-483c-89b2-8b15aae9b87e req-936c0522-9b68-4b1c-8224-8e30ed3ffe6e service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:12.374599 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-d276d805-9384-483c-89b2-8b15aae9b87e req-936c0522-9b68-4b1c-8224-8e30ed3ffe6e service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:12.387739 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-d276d805-9384-483c-89b2-8b15aae9b87e req-936c0522-9b68-4b1c-8224-8e30ed3ffe6e service nova] Creating event network-changed:424b2123-2ed7-4eda-bdcf-dd72a3df7bea for instance 4829f58c-adec-413d-83c8-23f1d3143205 on hv-cinder-85164 Aug 08 00:33:12.394675 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-d276d805-9384-483c-89b2-8b15aae9b87e req-936c0522-9b68-4b1c-8224-8e30ed3ffe6e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034333 Aug 08 00:33:12.396617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 54/112] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:33:12.836159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:12.837321 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:12.843686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:12.850312 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:12.850312 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:12.850312 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:12.850312 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:12.850970 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:12.929398 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:12.930919 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:12.939693 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:12.940863 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:12.942041 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:12.943164 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:12.944027 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:12.944689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:13.050798 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:13.058401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f3611221-92fb-4928-932e-6b8e1557a996 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1321 microversion: 2.1 time: 0.226357 Aug 08 00:33:13.058968 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 59/113] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:12 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:13.077293 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-9a3b20a3-1f93-4de1-ad7a-50e7bf979fe7 req-b7f1b6ff-d5ed-4590-9c45-10dbe6d251ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8968cf66-c321-4187-8166-47cdc6cc701e", "name": "network-vif-plugged", "status": "completed", "tag": "04d4459b-df65-4f20-b895-eaa736bf1d79"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:13.088359 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-9a3b20a3-1f93-4de1-ad7a-50e7bf979fe7 req-b7f1b6ff-d5ed-4590-9c45-10dbe6d251ac service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:13.089038 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-9a3b20a3-1f93-4de1-ad7a-50e7bf979fe7 req-b7f1b6ff-d5ed-4590-9c45-10dbe6d251ac service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:13.089629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-9a3b20a3-1f93-4de1-ad7a-50e7bf979fe7 req-b7f1b6ff-d5ed-4590-9c45-10dbe6d251ac service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:13.103065 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:13.103290 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-9a3b20a3-1f93-4de1-ad7a-50e7bf979fe7 req-b7f1b6ff-d5ed-4590-9c45-10dbe6d251ac service nova] Creating event network-vif-plugged:04d4459b-df65-4f20-b895-eaa736bf1d79 for instance 8968cf66-c321-4187-8166-47cdc6cc701e on hv-cinder-85164 Aug 08 00:33:13.109411 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-9a3b20a3-1f93-4de1-ad7a-50e7bf979fe7 req-b7f1b6ff-d5ed-4590-9c45-10dbe6d251ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035707 Aug 08 00:33:13.110527 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 60/114] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:33:13.115853 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a27d5027-4383-48ef-9c6d-c64061dd4410 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.191612 Aug 08 00:33:13.116438 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 55/115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:12 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:14.081501 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:14.082227 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:14.088863 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:14.090445 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:14.090445 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:14.090794 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:14.091259 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:14.091677 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:14.141312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:14.141951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:14.148066 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:14.148676 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:14.149298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:14.149999 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:14.150448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:14.150870 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:14.234475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:14.243542 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-992df788-41ae-4eb4-828d-1cfb5fb16d3f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1516 microversion: 2.1 time: 0.166997 Aug 08 00:33:14.244531 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 61/116] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:14 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:14.269923 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:14.271844 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:14.279370 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:14.280333 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:14.281131 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:14.282131 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:14.282780 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:14.283447 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:14.291456 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:14.299459 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ba717ce8-f7a3-45fa-91f4-b35f5518d300 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.162637 Aug 08 00:33:14.303265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 56/117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:14 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:14.355425 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lazy-loading 'flavor' on Instance uuid 9f8480cf-4061-4c55-8118-a74951cf6142 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:33:14.603452 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-685dc7f9-897a-4afa-8dd8-5124630baf9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142/action" status: 200 len: 32 microversion: 2.1 time: 0.341403 Aug 08 00:33:14.604120 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 62/118] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:33:14 2022] POST /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142/action => generated 32 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 00:33:14.614064 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:14.614670 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:14.620571 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:14.621065 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:14.621488 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:14.622161 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:14.622604 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:14.623019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:14.757567 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:14.765261 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ab2277bb-a6df-4aa4-afe7-8896b7ddf18f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.155041 Aug 08 00:33:14.765835 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 57/119] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:14 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:15.320943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:15.321656 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:15.335911 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:15.335911 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:15.335911 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:15.335911 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:15.336286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:15.336286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:15.489282 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:15.496688 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d6fa0811-03df-4fb4-ba7d-fce3fd75c57a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.179930 Aug 08 00:33:15.498403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 63/120] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:15 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:15.785948 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:15.786666 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:15.792894 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:15.793384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:15.793812 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:15.794495 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:15.794936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:15.795401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:15.928507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:15.936070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6131db86-0a07-4782-9ac1-7892d5e352f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.154166 Aug 08 00:33:15.937373 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 58/121] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:15 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:16.517743 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:16.518395 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:16.524693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:16.530495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:16.530495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:16.530495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:16.530495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:16.530870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:16.657406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:16.665334 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-753da73d-4c83-44e8-ab76-ea43ef431ed3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.151758 Aug 08 00:33:16.666163 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 64/122] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:16 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:16.958564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:16.959450 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:16.965981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:16.966445 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:16.966871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:16.968668 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:16.969280 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:16.969749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:17.101565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:17.109949 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f9c19765-3c19-421e-afed-ec72a7cf731b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.155001 Aug 08 00:33:17.110882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 59/123] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:16 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:17.685855 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:17.686571 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:17.692631 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:17.693189 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:17.693686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:17.694442 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:17.694963 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:17.695479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:17.834152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:17.841880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c2dd4338-8184-47a8-8365-2ffd446e9779 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1315 microversion: 2.1 time: 0.159888 Aug 08 00:33:17.842976 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 65/124] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:17 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:18.131514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:18.132148 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:18.138688 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:18.139185 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:18.140144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:18.140845 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:18.141294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:18.141724 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:18.426768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:18.435639 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-42f15239-9f68-44b1-aeae-c7b5c6429b5c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.307956 Aug 08 00:33:18.436258 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 60/125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:18 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:18.863062 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:18.863700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:18.869603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:18.870080 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:18.870511 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:18.871240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:18.871696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:18.872119 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:19.002078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:19.009470 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3b533153-1435-43de-964f-a496949f19d4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1502 microversion: 2.1 time: 0.151052 Aug 08 00:33:19.010039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 66/126] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:18 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:19.459170 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:19.459818 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:19.466899 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:19.467717 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:19.468322 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:19.469280 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:19.470299 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:19.470736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:19.612853 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:19.620718 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3cbb0277-1817-490a-86e3-c4dd21747fc7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.167086 Aug 08 00:33:19.621291 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 61/127] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:19 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:20.641835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:20.643156 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:20.649391 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:20.649899 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:20.650332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:20.651089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:20.651533 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:20.651961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:20.779554 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:20.787192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-18dceb02-b3db-411c-87ac-d707dd724554 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.149129 Aug 08 00:33:20.787773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 67/128] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:20 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:21.808610 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:21.809134 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:21.815324 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:21.815796 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:21.816238 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:21.816897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:21.817366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:21.817787 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:21.949489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:21.957868 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f3e818c8-8619-4d47-b23d-ae7ab7075a09 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.153512 Aug 08 00:33:21.958434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 62/129] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:21 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:22.979476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:22.980080 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:22.986855 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:22.987360 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:22.987795 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:22.988484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:22.988936 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:22.989355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:23.129439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:23.137974 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9e02741c-169b-467a-ae6c-8e83c7ecc482 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.162204 Aug 08 00:33:23.147319 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 68/130] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:22 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:24.159681 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:24.160902 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:24.167078 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:24.167597 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:24.168289 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:24.168709 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:24.169330 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:24.171315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:24.304213 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:24.311817 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-03adb5cc-ef47-49b8-85e3-5743d6d3be4f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.155943 Aug 08 00:33:24.312376 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 63/131] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:24 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:25.333148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:25.333748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:25.340095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:25.341426 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:25.341426 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:25.341742 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:25.342189 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:25.342606 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:25.470468 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:25.473996 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:25.478450 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c56f1cac-909d-4cf8-a568-53713be78edd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.149824 Aug 08 00:33:25.479023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 69/132] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:25 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:26.426494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6ffab667-9ad9-4a62-b0e9-9d5ec2b387dd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db37df11-b6cd-4fd6-bf92-fe838bd4bcdc"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:26.426494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6ffab667-9ad9-4a62-b0e9-9d5ec2b387dd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:26.427419 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=68 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:26.432370 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ffab667-9ad9-4a62-b0e9-9d5ec2b387dd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:26.433011 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ffab667-9ad9-4a62-b0e9-9d5ec2b387dd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:26.433618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ffab667-9ad9-4a62-b0e9-9d5ec2b387dd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:26.434533 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ffab667-9ad9-4a62-b0e9-9d5ec2b387dd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:26.435293 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ffab667-9ad9-4a62-b0e9-9d5ec2b387dd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:26.436031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ffab667-9ad9-4a62-b0e9-9d5ec2b387dd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:26.502672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:26.502672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:26.508670 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:26.509614 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:26.510464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:26.511425 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:26.511952 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:26.512447 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:26.661453 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:26.670113 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b7df6780-6878-4742-8000-bfb6b0edeedb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.174131 Aug 08 00:33:26.679549 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 70/133] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:26 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:27.478025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6ffab667-9ad9-4a62-b0e9-9d5ec2b387dd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "POST /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.058980 Aug 08 00:33:27.478627 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 64/134] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:33:26 2022] POST /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d/os-volume_attachments => generated 194 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:33:27.693534 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:27.694690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:27.702569 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:27.707451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:27.707451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:27.707451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:27.707451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:27.707751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:27.853361 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:27.861529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e2c230e6-c597-44dc-984c-34443610a18e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.172261 Aug 08 00:33:27.862095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 71/135] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:27 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:28.883752 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:28.884560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:28.890773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:28.891418 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:28.891927 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:28.892735 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:28.893249 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:28.893747 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:29.066270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:29.074713 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-bcdc6010-10b3-4d36-a19a-fe3215c4a715 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.195893 Aug 08 00:33:29.075409 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 65/136] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:28 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:30.099626 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:30.100230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:30.107133 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:30.107902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:30.108533 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:30.109421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:30.110064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:30.111255 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:30.248378 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:30.256863 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3bd3c595-7024-4f7d-8e00-46f5b42dc17f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.163470 Aug 08 00:33:30.257405 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 72/137] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:30 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:31.277732 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:31.278331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:31.285455 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:31.285712 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:31.286148 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:31.286957 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:31.287447 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:31.287873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:31.444580 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:31.452488 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5ffa15d7-9726-46c6-8fb7-515cd2c8ba73 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.178489 Aug 08 00:33:31.453064 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 66/138] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:31 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:32.474703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:32.475350 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:32.481328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:32.481809 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:32.482241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:32.482932 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:32.483440 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:32.483866 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:32.627961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:32.646200 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-57c27e13-587c-46b6-85c3-2b9bb2d06094 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.176130 Aug 08 00:33:32.652966 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 73/139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:32 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:33.676055 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:33.677394 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:33.684239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:33.684930 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:33.685419 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:33.689353 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:33.689353 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:33.689353 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:33.828189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:33.837221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-71eb4e9a-ed1d-4fa4-b832-f2fcd06c3cd5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.165152 Aug 08 00:33:33.837792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 67/140] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:33 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:34.858605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:34.859876 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:34.862272 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=64 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:34.869828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:34.869828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:34.869828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:34.869828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:34.870216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:34.870216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:35.018700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:35.018700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-33cfdf53-f2bb-4413-938d-7794a4522d29 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.162647 Aug 08 00:33:35.018700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 74/141] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:34 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:36.038602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:36.039602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:36.046350 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:36.046830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:36.047271 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:36.048132 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:36.048767 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:36.049418 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:36.194531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:36.203662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fdfee4dd-ab39-4eea-a6bf-bd72af00cea4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.169071 Aug 08 00:33:36.204311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 68/142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:36 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:36.813668 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:36.814207 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:36.820243 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:36.820803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:36.821141 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:36.821892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:36.822371 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:36.822809 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:36.868314 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:33:37.225470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:37.226076 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:37.232786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:37.233275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:37.233705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:37.234507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:37.234956 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:37.235411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:37.252205 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e6e45a46-cb52-49a7-b981-70184c1cedfd tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "DELETE /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 204 len: 0 microversion: 2.1 time: 0.442043 Aug 08 00:33:37.252989 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 75/143] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:33:36 2022] DELETE /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:33:37.261471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:37.262405 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:37.269366 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:37.269849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:37.270518 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:37.271424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:37.272055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:37.272661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:37.369713 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:37.373231 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:37.378091 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-88124eef-08c1-40f2-adc5-812b940eda2e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.156782 Aug 08 00:33:37.378858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 69/144] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:37 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:37.406841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:37.414844 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ed8a7288-2c5d-4c5f-ae3f-b2339d58e448 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1554 microversion: 2.1 time: 0.157406 Aug 08 00:33:37.415451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 76/145] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:37 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:38.399559 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:38.400326 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:38.407124 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:38.407628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:38.408779 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:38.409486 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:38.409939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:38.410364 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:38.437074 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:38.437673 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:38.444484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:38.448159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:38.448159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:38.448159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:38.448159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:38.448439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:38.538307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:38.545998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-29321de7-d054-4cb2-a8a7-c363f9fa3ef0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.150403 Aug 08 00:33:38.546642 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 70/146] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:38 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:38.580740 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:38.588905 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-85aae238-b768-4c3c-9c9d-c3763ad2e12f tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1554 microversion: 2.1 time: 0.155768 Aug 08 00:33:38.589464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 77/147] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:38 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:39.567345 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:39.567960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:39.574428 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:39.574904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:39.575371 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:39.576190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:39.576638 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:39.577057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:39.609645 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:39.610253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:39.616925 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:39.617409 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:39.617841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:39.618533 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:39.618995 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:39.619479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:39.710367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:39.719660 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-58ec2280-986b-4268-ac2f-689270d164f6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.156399 Aug 08 00:33:39.721179 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 71/148] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:39 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:39.758044 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:39.767208 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c1de639b-c4a0-49d2-a246-732bf539bfc3 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1554 microversion: 2.1 time: 0.160790 Aug 08 00:33:39.767552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 78/149] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:39 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:40.741398 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:40.741977 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:40.748622 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:40.749098 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:40.749526 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:40.750311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:40.750642 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:40.751057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:40.792080 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:40.794413 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:40.808585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:40.809438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:40.810148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:40.811180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:40.812049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:40.812713 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:40.919836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:40.928182 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e2636292-d224-48af-ab7c-7f5fc139e3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.190547 Aug 08 00:33:40.928763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 72/150] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:40 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:40.975523 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:40.983696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-847624b2-03b9-4253-959f-76602e0f90aa tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1554 microversion: 2.1 time: 0.199760 Aug 08 00:33:40.987636 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 79/151] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:40 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:41.949980 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:41.950591 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:41.959107 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:41.959894 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:41.960325 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:41.961225 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:41.961688 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:41.962117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:42.006561 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:42.007283 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:42.013945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:42.014537 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:42.015136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:42.015937 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:42.016484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:42.016974 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:42.101858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:42.109790 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3fb57ae5-33f7-4681-ac56-96fb152fe1c4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.163607 Aug 08 00:33:42.110365 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 73/152] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:41 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:42.154304 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:42.162605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d48ddb9b-ba3f-4f9b-a0d4-8cffeab74115 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1554 microversion: 2.1 time: 0.160496 Aug 08 00:33:42.163169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 80/153] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:42 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:43.130893 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:43.131537 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:43.138000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:43.138484 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:43.140304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:43.140304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:43.140304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:43.140851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:43.183863 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:43.184600 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:43.191541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:43.192030 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:43.192466 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:43.193254 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:43.193703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:43.194338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:43.281943 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:43.294281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-09f0feea-88e9-486f-9df5-3ce022321f5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.167143 Aug 08 00:33:43.294857 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 74/154] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:43 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:43.347968 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:43.353454 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-25eda03a-1440-45fa-8a71-55d617ee16f4 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1554 microversion: 2.1 time: 0.173316 Aug 08 00:33:43.354114 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 81/155] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:43 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:44.316947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:44.317546 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:44.324456 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:44.324940 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:44.325395 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:44.326112 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:44.326606 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:44.327070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:44.374875 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:44.375493 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:44.382660 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:44.383378 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:44.383864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:44.384497 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:44.384946 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:44.385412 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:44.464737 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:44.472546 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ddb52216-8c1d-4ac4-b723-4733182f3d4d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.160128 Aug 08 00:33:44.473115 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 75/156] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:44 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:44.523891 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:44.531824 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bd568926-7fac-4ba0-a7e2-88771ab7f992 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1554 microversion: 2.1 time: 0.160764 Aug 08 00:33:44.532388 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 82/157] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:44 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:45.493996 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:45.494595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:45.501177 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:45.501666 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:45.502122 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:45.503007 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:45.503487 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:45.504002 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:45.554510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:45.555138 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:45.561805 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:45.562284 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:45.562730 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:45.563500 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:45.563960 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:45.564388 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:45.714867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:45.723912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-dfdebdd6-7d57-431d-bc05-9f19b5244f5e tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1554 microversion: 2.1 time: 0.175070 Aug 08 00:33:45.724506 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 83/158] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:45 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:45.865195 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:45.872935 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c94a8687-2044-4b14-8272-5dbe1528a849 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.382835 Aug 08 00:33:45.873505 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 76/159] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:45 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:46.702459 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-ef7771d3-7a71-4240-be6f-e6438ff8061e req-3624b6f3-d72e-4fe2-b9de-fb5c0617e498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127db5f0-f5b7-4e93-889a-603eae1f3e3d", "name": "network-vif-unplugged", "status": "completed", "tag": "f3753ab8-b02b-4899-add3-0636f7b130d3"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:46.716505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-ef7771d3-7a71-4240-be6f-e6438ff8061e req-3624b6f3-d72e-4fe2-b9de-fb5c0617e498 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:46.717096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-ef7771d3-7a71-4240-be6f-e6438ff8061e req-3624b6f3-d72e-4fe2-b9de-fb5c0617e498 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:46.717413 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-ef7771d3-7a71-4240-be6f-e6438ff8061e req-3624b6f3-d72e-4fe2-b9de-fb5c0617e498 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:46.732817 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-ef7771d3-7a71-4240-be6f-e6438ff8061e req-3624b6f3-d72e-4fe2-b9de-fb5c0617e498 service nova] Creating event network-vif-unplugged:f3753ab8-b02b-4899-add3-0636f7b130d3 for instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d on hv-cinder-85164 Aug 08 00:33:46.745091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-ef7771d3-7a71-4240-be6f-e6438ff8061e req-3624b6f3-d72e-4fe2-b9de-fb5c0617e498 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040117 Aug 08 00:33:46.745091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 84/160] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:33:46.745837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:46.746246 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:46.759583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:46.760176 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:46.760534 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:46.763697 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:46.764167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:46.764602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:46.895403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:46.896199 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:46.902458 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:46.903248 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:46.903808 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:46.904672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:46.905216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:46.905737 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:46.926585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:47.044060 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:47.055583 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b33effae-7af5-4773-934c-f9ce5ab2aad0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.164526 Aug 08 00:33:47.056346 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 85/161] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:46 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:47.108228 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:47.117189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ba64c52f-5464-41cc-ba00-3c61a10db954 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1554 microversion: 2.1 time: 0.375369 Aug 08 00:33:47.117763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 77/162] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:46 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1554 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:47.561372 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-a02f5ffa-fe4a-4a30-8d2a-7b56cd5ce9d0 req-f92a30f4-31c7-4680-b3a6-af8414b261e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127db5f0-f5b7-4e93-889a-603eae1f3e3d", "name": "network-vif-deleted", "tag": "f3753ab8-b02b-4899-add3-0636f7b130d3"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:47.561691 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-a02f5ffa-fe4a-4a30-8d2a-7b56cd5ce9d0 req-f92a30f4-31c7-4680-b3a6-af8414b261e7 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:47.566444 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-a02f5ffa-fe4a-4a30-8d2a-7b56cd5ce9d0 req-f92a30f4-31c7-4680-b3a6-af8414b261e7 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:47.567024 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-a02f5ffa-fe4a-4a30-8d2a-7b56cd5ce9d0 req-f92a30f4-31c7-4680-b3a6-af8414b261e7 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:47.584119 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-a02f5ffa-fe4a-4a30-8d2a-7b56cd5ce9d0 req-f92a30f4-31c7-4680-b3a6-af8414b261e7 service nova] Creating event network-vif-deleted:f3753ab8-b02b-4899-add3-0636f7b130d3 for instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d on hv-cinder-85164 Aug 08 00:33:47.590070 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-a02f5ffa-fe4a-4a30-8d2a-7b56cd5ce9d0 req-f92a30f4-31c7-4680-b3a6-af8414b261e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048205 Aug 08 00:33:47.590805 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 86/163] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:33:48.076939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:48.077552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:48.085162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:48.085673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:48.086056 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:48.086750 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:48.087211 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:48.087645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:48.146438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:48.147170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:48.155887 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:48.158135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:48.158135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:48.158135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:48.158135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:48.159330 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:48.223596 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:48.226958 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:48.231187 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ce0d52a7-97eb-4dbe-8b89-d23ce5d3e24d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1522 microversion: 2.1 time: 0.158160 Aug 08 00:33:48.232017 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 78/164] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:48 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:48.235632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cdd2700e-8aaf-465e-ac22-ca9cef5e3213 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1346 microversion: 2.1 time: 0.095392 Aug 08 00:33:48.236273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 87/165] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:48 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:49.253739 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:49.254407 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:49.257471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:49.258089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:49.261542 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:49.262276 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:49.263426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:49.264138 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:49.264593 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:49.265018 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:49.265247 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:49.265851 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:49.266296 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:49.267075 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:49.267566 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:49.268129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:49.301710 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:49.302176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:49.302616 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:49.303067 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lazy-loading 'fault' on Instance uuid 127db5f0-f5b7-4e93-889a-603eae1f3e3d {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:33:49.351696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be18a802a38143518bb0bb79afaae011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7214cb5b7d4c4c949c84dc81601a89e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:49.359165 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-06a19497-3725-45f4-8a96-1cc00338fd16 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 200 len: 1305 microversion: 2.1 time: 0.105281 Aug 08 00:33:49.359825 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 88/166] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:49 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:49.409220 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:49.421036 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-51e5ba2d-90c0-43a1-9c26-5195fb3d6241 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1502 microversion: 2.1 time: 0.171547 Aug 08 00:33:49.421619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 79/167] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:49 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:49.447063 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:49.447322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:49.454001 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:49.454479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:49.455758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:49.457738 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:49.458381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:49.458800 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:49.595133 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:49.603399 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ced02a5e-d9be-4686-af30-dd5d818af45e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1516 microversion: 2.1 time: 0.160837 Aug 08 00:33:49.603987 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 89/168] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:49 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:50.384905 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:50.385596 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:50.392844 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:50.393861 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:50.394374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:50.395156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:50.395702 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:50.396388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:50.419116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] HTTP exception thrown: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Request method failure captured: Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d HTTP/1.1 Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fmj_JS9KkMlrYpEvLS3AfRb4nYvU5UqaNVS4xKNKuJwYYqiQtuXgDlt3mjnm2FY2Voz1ccRcfcG544zfHfMcK27z84gukRmPjv6-KTaIXTVrxrRv5XsS_2C8pMvNm6g63pVZu-3Ac9bnNQtEeYd4z1HlZAK0elYSRFEgkVD7PfNE9w Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 7214cb5b7d4c4c949c84dc81601a89e0 Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:33:50.425044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 7214cb5b7d4c4c949c84dc81601a89e0 Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-DeleteServersTestJSON-191410030-project Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: be18a802a38143518bb0bb79afaae011 Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-DeleteServersTestJSON-191410030-project Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.426452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '127db5f0-f5b7-4e93-889a-603eae1f3e3d'} Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:33:50.427265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.428423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.430890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Returning 404 to user: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:33:50.434607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0682a543-b29d-4b74-bdcd-4a891ba3b688 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 404 len: 111 microversion: 2.1 time: 0.051247 Aug 08 00:33:50.435800 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 80/169] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:50 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:33:50.721204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:50.722670 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:50.728959 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:50.729401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:50.729788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:50.730491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:50.730945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:50.731415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:50.746126 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] HTTP exception thrown: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Request method failure captured: Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d/os-volume_attachments HTTP/1.1 Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fmj_JS9KkMlrYpEvLS3AfRb4nYvU5UqaNVS4xKNKuJwYYqiQtuXgDlt3mjnm2FY2Voz1ccRcfcG544zfHfMcK27z84gukRmPjv6-KTaIXTVrxrRv5XsS_2C8pMvNm6g63pVZu-3Ac9bnNQtEeYd4z1HlZAK0elYSRFEgkVD7PfNE9w Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 7214cb5b7d4c4c949c84dc81601a89e0 Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:33:50.750416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 7214cb5b7d4c4c949c84dc81601a89e0 Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-DeleteServersTestJSON-191410030-project Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: be18a802a38143518bb0bb79afaae011 Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-DeleteServersTestJSON-191410030-project Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.752471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'server_id': '127db5f0-f5b7-4e93-889a-603eae1f3e3d'} Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:33:50.753438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:50.754491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:50.756816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Returning 404 to user: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:33:50.757825 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-116e4316-0632-4cc7-8608-a5bb31ff08d2 tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043904 Aug 08 00:33:50.758450 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 90/170] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:33:50 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:33:53.406797 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:53.406797 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:53.413058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:53.413717 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:53.413975 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:53.414676 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:53.415127 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:53.415588 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:53.430315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] HTTP exception thrown: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Request method failure captured: Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d HTTP/1.1 Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fmj_JS9KkMlrYpEvLS3AfRb4nYvU5UqaNVS4xKNKuJwYYqiQtuXgDlt3mjnm2FY2Voz1ccRcfcG544zfHfMcK27z84gukRmPjv6-KTaIXTVrxrRv5XsS_2C8pMvNm6g63pVZu-3Ac9bnNQtEeYd4z1HlZAK0elYSRFEgkVD7PfNE9w Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 7214cb5b7d4c4c949c84dc81601a89e0 Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:33:53.431802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 7214cb5b7d4c4c949c84dc81601a89e0 Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-DeleteServersTestJSON-191410030-project Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: be18a802a38143518bb0bb79afaae011 Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-DeleteServersTestJSON-191410030-project Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.433292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '127db5f0-f5b7-4e93-889a-603eae1f3e3d'} Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:33:53.434110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.435298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.436620 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Returning 404 to user: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:33:53.436620 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-99b079a1-2cdc-4f86-ba23-d0197be0b78a tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "DELETE /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 404 len: 111 microversion: 2.1 time: 0.031862 Aug 08 00:33:53.436620 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 81/171] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:33:53 2022] DELETE /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:33:53.442542 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:53.443325 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] [instance: 127db5f0-f5b7-4e93-889a-603eae1f3e3d] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:53.449464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:53.449959 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:53.450395 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:53.451103 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:53.451568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:53.451994 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:53.470650 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] HTTP exception thrown: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Request method failure captured: Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d HTTP/1.1 Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fmj_JS9KkMlrYpEvLS3AfRb4nYvU5UqaNVS4xKNKuJwYYqiQtuXgDlt3mjnm2FY2Voz1ccRcfcG544zfHfMcK27z84gukRmPjv6-KTaIXTVrxrRv5XsS_2C8pMvNm6g63pVZu-3Ac9bnNQtEeYd4z1HlZAK0elYSRFEgkVD7PfNE9w Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 7214cb5b7d4c4c949c84dc81601a89e0 Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:33:53.473146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7214cb5b7d4c4c949c84dc81601a89e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 7214cb5b7d4c4c949c84dc81601a89e0 Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-DeleteServersTestJSON-191410030 Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-DeleteServersTestJSON-191410030-project Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: be18a802a38143518bb0bb79afaae011 Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-DeleteServersTestJSON-191410030-project Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.474665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '127db5f0-f5b7-4e93-889a-603eae1f3e3d'} Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:33:53.475692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. Aug 08 00:33:53.477515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:33:53.479673 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] Returning 404 to user: Instance 127db5f0-f5b7-4e93-889a-603eae1f3e3d could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:33:53.480699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-24d5a9e7-1daa-439b-99ff-fc440a35713c tempest-DeleteServersTestJSON-191410030 tempest-DeleteServersTestJSON-191410030-project] 10.222.0.15 "GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d" status: 404 len: 111 microversion: 2.1 time: 0.042948 Aug 08 00:33:53.484915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 91/172] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:53 2022] GET /compute/v2.1/servers/127db5f0-f5b7-4e93-889a-603eae1f3e3d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:33:53.594078 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:33:53.600924 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:53.611991 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:53.614010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:53.614685 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:53.616008 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:53.617123 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:53.617770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:53.659471 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lazy-loading 'flavor' on Instance uuid 8968cf66-c321-4187-8166-47cdc6cc701e {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:33:54.112161 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5ec70f34-a082-4fa8-9e25-6ecd14ed7d9d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e/action" status: 200 len: 32 microversion: 2.1 time: 0.525030 Aug 08 00:33:54.113229 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 82/173] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:33:53 2022] POST /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 00:33:54.123817 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:54.124470 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:54.131081 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:54.131600 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:54.132049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:54.132756 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:54.133214 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:54.133641 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:54.581456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:54.591314 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8f0677bc-afd3-456f-81a7-d7acce9b3501 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.471324 Aug 08 00:33:54.603361 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 92/174] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:54 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:55.615467 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:55.616168 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:55.623012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:55.623845 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:55.624448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:55.625595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:55.626210 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:55.626829 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:55.799268 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:55.807923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9fcdeca4-2edc-4d6e-85f3-299da21c558b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.197818 Aug 08 00:33:55.808768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 83/175] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:55 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:56.829805 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:56.830454 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:56.838182 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:56.838677 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:56.839334 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:56.840048 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:56.840506 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:56.840943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:57.064832 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:57.077850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-11cfb545-3f49-4eee-80f8-fdbcc4e24e54 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.250029 Aug 08 00:33:57.077850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 93/176] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:56 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:33:58.112141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:58.112141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:58.112141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=40 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:33:58.117507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:58.118610 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:58.119571 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:58.120802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:58.120949 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:58.121576 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:58.389067 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:58.397439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e9c19be0-5aae-44cb-b43f-cc3dd4be88c2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.298493 Aug 08 00:33:58.398021 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 84/177] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:58 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:33:59.417843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:33:59.418474 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:33:59.426511 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:59.426996 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:59.427450 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:59.428357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:33:59.428620 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:33:59.429109 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:33:59.563724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:33:59.571646 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0b1d3606-0070-4e46-ac21-600d556c57c0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.157479 Aug 08 00:33:59.572232 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 94/178] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:33:59 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:00.593886 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:00.594482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:00.601632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:00.602115 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:00.602548 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:00.603297 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:00.603750 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:00.604174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:00.777511 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:00.781014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:00.786107 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c115474b-197f-43b5-bef8-3549f0e55cad tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.195963 Aug 08 00:34:00.786683 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 85/179] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:00 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:01.808515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:01.809136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:01.815060 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:01.815583 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:01.816014 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:01.816704 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:01.817157 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:01.817576 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:01.990652 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:01.999448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6eaaf5ba-1bbd-4c89-bad7-dc248b11ce8a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.194703 Aug 08 00:34:02.013920 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 95/180] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:01 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:03.026471 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:03.027085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:03.039074 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:03.039925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:03.040594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:03.042931 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:03.043929 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:03.047646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:03.326423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:03.335440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9360c1f3-703c-4b46-aa66-254ed0accd3d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.317411 Aug 08 00:34:03.336222 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 86/181] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:03 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:04.364891 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:04.366083 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:04.372223 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:04.372645 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:04.373076 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:04.373769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:04.374213 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:04.374659 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:04.517981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:04.526030 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2725e572-850e-4177-9844-5a5d98ad7062 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.165927 Aug 08 00:34:04.526538 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 96/182] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:04 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:05.551637 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:05.556886 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:05.568401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:05.569703 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:05.570367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:05.572013 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:05.572713 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:05.573769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:05.797460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:05.806664 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-278d1871-5472-4317-867f-6b715479d991 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.263743 Aug 08 00:34:05.807354 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 87/183] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:05 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:06.844742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:06.846675 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:06.854336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:06.855072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:06.855766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:06.856513 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:06.857193 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:06.857617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:06.936513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-233908ea-4c01-4027-9b73-23c3ffda6ba6 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: .version_select at 0x7fd1a2964820>, body: {"keypair": {"name": "tempest-keypair-1414492894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqg4PZ2wEt6AG3xVecdhD9lJMzp1qIkbjMquCGEG4cgHPkcm8KQCWHxMZMG+aPMpoMEwPWaEUac7UWWn3FNidP96InUViblKWFVukZ9BdvnhKA/XvB1sDoiXlgeLs8gRg=="}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:06.955033 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:06.976088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-233908ea-4c01-4027-9b73-23c3ffda6ba6 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for project e97eb34021d44eb0a99763034c1e9e87. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:34:06.986465 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-233908ea-4c01-4027-9b73-23c3ffda6ba6 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for user 7b317f585f8a4da3abe24ab5cf4ee0c0 and project e97eb34021d44eb0a99763034c1e9e87. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:34:07.038927 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:07.048631 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-479e0d3f-a863-4932-81da-37af125d4b5b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.223618 Aug 08 00:34:07.050047 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 88/184] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:06 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:07.104512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-233908ea-4c01-4027-9b73-23c3ffda6ba6 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.358057 Aug 08 00:34:07.105475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 97/185] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:34:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:34:08.081686 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:08.082514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:08.089721 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:08.090208 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:08.090640 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:08.091374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:08.091825 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:08.092327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:08.247132 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:08.254944 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fc8d7847-9ec2-4455-be69-8f5aad555e8f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.180395 Aug 08 00:34:08.255541 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 89/186] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:08 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:09.276705 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:09.277597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:09.285414 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:09.285981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:09.286499 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:09.287341 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:09.287901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:09.288502 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:09.700298 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:09.722387 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fb2f650e-0c5d-4864-8139-67c03540bef8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.448678 Aug 08 00:34:09.723026 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 98/187] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:09 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:10.019268 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1392860208", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5ea35fc-5529-4ec7-b035-b5f2637c5acc"}], "security_groups": [{"name": "tempest-securitygroup--1407275576"}], "key_name": "tempest-keypair-1414492894", "user_data": "}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:10.140021 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] validate_networks() for [('a5ea35fc-5529-4ec7-b035-b5f2637c5acc', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:34:10.537471 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:34:10.537892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:34:10.538363 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:34:10.538769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:34:10.539171 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:34:10.547996 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:10.548467 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:10.548893 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:10.550133 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:10.550577 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:10.551000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:10.577206 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for project e97eb34021d44eb0a99763034c1e9e87. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:34:10.581777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for user 7b317f585f8a4da3abe24ab5cf4ee0c0 and project e97eb34021d44eb0a99763034c1e9e87. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:34:10.594957 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:34:10.598000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:34:10.744072 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:10.744580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:10.757580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:10.757580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:10.757580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:10.757580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:10.758190 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:10.758190 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:10.791878 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1ec4a6d2-14fd-4ca2-a22c-111d2f038010 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779010 Aug 08 00:34:10.792524 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 90/188] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:34:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:34:10.803313 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d55de15d-08ff-49aa-8576-462f1c9a91db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:10.803973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d55de15d-08ff-49aa-8576-462f1c9a91db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:10.866074 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d55de15d-08ff-49aa-8576-462f1c9a91db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:10.878760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d55de15d-08ff-49aa-8576-462f1c9a91db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1242 microversion: 2.1 time: 0.079198 Aug 08 00:34:10.891884 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 91/189] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:10 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:10.925482 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:10.933206 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b0ecec1b-6f97-4851-b4fa-16ef9fbf3089 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.193182 Aug 08 00:34:10.933782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 99/190] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:10 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:11.899666 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:11.900388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:11.907025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:11.908000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:11.908000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:11.908682 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:11.909136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:11.909560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:11.963069 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:11.964087 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:11.972471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:11.972985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:11.973663 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:11.974884 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:11.975509 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:11.976391 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:11.997842 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:12.014663 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a7b98085-fd0f-4a82-8000-b453215652e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1246 microversion: 2.1 time: 0.118690 Aug 08 00:34:12.016845 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 92/191] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:11 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1246 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:12.136778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:12.149725 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-410a3453-c304-43b4-b287-75af4d4c0005 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.195571 Aug 08 00:34:12.150467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 100/192] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:11 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:13.041390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:13.042136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:13.048550 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:13.049019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:13.049906 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:13.050701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:13.051153 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:13.051596 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:13.115778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:13.123589 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-cb05133b-318c-40ad-a473-2008d721ee5c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1294 microversion: 2.1 time: 0.086113 Aug 08 00:34:13.124144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 93/193] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:13 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:13.173113 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:13.174604 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:13.182498 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:13.182985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:13.183448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:13.184151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:13.184601 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:13.185055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:13.330546 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:13.341133 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-304edb7d-34fd-4553-8afb-abd565efee95 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.173359 Aug 08 00:34:13.341732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 101/194] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:13 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:14.145467 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:14.147305 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:14.160281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:14.160938 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:14.161468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:14.162903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:14.163707 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:14.164344 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:14.276781 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:14.284778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4f90efa4-67be-455f-97e4-934c583034df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1302 microversion: 2.1 time: 0.143515 Aug 08 00:34:14.285351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 94/195] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:14 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1302 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:14.364110 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:14.365267 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:14.379967 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:14.380474 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:14.380952 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:14.381799 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:14.382239 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:14.382676 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:14.583452 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:14.603725 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-95c494c5-887d-4dbf-9c60-a92feeba10d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1502 microversion: 2.1 time: 0.240430 Aug 08 00:34:14.604672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 102/196] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:14 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:14.624519 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24ae4c14-5f91-49d1-9a94-0856dbe6a6aa"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:14.626848 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:14.633594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:14.634091 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:14.634527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:14.635553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:14.636011 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:14.636437 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:14.681444 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] HTTP exception thrown: Cannot 'attach_volume' instance 8968cf66-c321-4187-8166-47cdc6cc701e while it is in vm_state rescued Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Request method failure captured: Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: POST /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e/os-volume_attachments HTTP/1.1 Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 74 Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FmiSdbrB2DQZbEo_7DUiSWc_4dae8wGG5xoFF5XZW8ovdJ5Pc-0c4-PyjQUjY4ASLkMp8v9RZbQw52NYnVCxcI5HiJA30AQUXRi0xuHJal7gwJJpJT0uN2V2ZaWbeHIZd479JeoVYQI2OaPhELhP0Lhs3-4ZUcVAzxMiEhitsXyfTo Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:34:14.684262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: c0aa06eea99f4011ab85ec51b0e60f2c Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {"volumeAttachment": {"volumeId": "24ae4c14-5f91-49d1-9a94-0856dbe6a6aa"}} Aug 08 00:34:14.685788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Cannot 'attach_volume' instance 8968cf66-c321-4187-8166-47cdc6cc701e while it is in vm_state rescued Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'server_id': '8968cf66-c321-4187-8166-47cdc6cc701e', 'body': {'volumeAttachment': {'volumeId': '24ae4c14-5f91-49d1-9a94-0856dbe6a6aa'}}} Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8968cf66-c321-4187-8166-47cdc6cc701e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:34:14.686641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8968cf66-c321-4187-8166-47cdc6cc701e while it is in vm_state rescued Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:34:14.689346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:34:14.691561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:34:14.691561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:34:14.691561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8968cf66-c321-4187-8166-47cdc6cc701e while it is in vm_state rescued Aug 08 00:34:14.691561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:34:14.692429 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Returning 409 to user: Cannot 'attach_volume' instance 8968cf66-c321-4187-8166-47cdc6cc701e while it is in vm_state rescued {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:34:14.694740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-09a1a14e-2ac9-4de6-81fc-49b44bd4d5d2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074105 Aug 08 00:34:14.695684 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 95/197] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:34:14 2022] POST /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 08 00:34:14.704523 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1ee623f9-8455-44ea-86c5-68bc413ce3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:14.705953 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1ee623f9-8455-44ea-86c5-68bc413ce3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:14.712399 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ee623f9-8455-44ea-86c5-68bc413ce3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:14.717510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ee623f9-8455-44ea-86c5-68bc413ce3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:14.717510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ee623f9-8455-44ea-86c5-68bc413ce3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:14.717510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ee623f9-8455-44ea-86c5-68bc413ce3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:14.717510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ee623f9-8455-44ea-86c5-68bc413ce3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:14.717910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ee623f9-8455-44ea-86c5-68bc413ce3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:14.889249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:15.048622 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1ee623f9-8455-44ea-86c5-68bc413ce3b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e/action" status: 202 len: 0 microversion: 2.1 time: 0.347726 Aug 08 00:34:15.050023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 103/198] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:34:14 2022] POST /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 00:34:15.066841 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:15.068783 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:15.086146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:15.087004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:15.087641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:15.089239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:15.089862 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:15.090595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:15.308857 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:15.309553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:15.316225 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:15.318513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:15.318513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:15.318513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:15.318513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:15.318865 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:15.335696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:15.348140 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-aeef5bb5-b72d-4c27-ba29-caadb1857f65 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1510 microversion: 2.1 time: 0.287504 Aug 08 00:34:15.349087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 96/199] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:15 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:15.524494 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:15.533048 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b604210d-5c3d-4e0a-b808-b2453074a986 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.228272 Aug 08 00:34:15.533929 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 104/200] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:15 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:16.371016 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:16.372307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:16.379252 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:16.379757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:16.380189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:16.380906 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:16.381349 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:16.381765 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:16.554868 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:16.555621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:16.563545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:16.564016 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:16.564525 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:16.565996 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:16.566463 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:16.566892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:16.644967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:16.657765 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-262d70ab-ac59-4bd7-87e3-e6763c893bbc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1510 microversion: 2.1 time: 0.291541 Aug 08 00:34:16.658365 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 97/201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:16 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:16.737661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:16.745253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-389810db-55c9-429e-94b4-07bedb54795c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.194327 Aug 08 00:34:16.746379 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 105/202] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:16 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:17.013666 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-4c271132-6d42-460c-961f-a54e2bdd5e3e req-7b670226-2dc2-447d-b8be-a3a6b9e79460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728de657-b1e9-4f61-8dcf-d5cc9553eb16", "tag": "32463a74-b851-44eb-9dbb-f33e871b6327"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:17.023720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-4c271132-6d42-460c-961f-a54e2bdd5e3e req-7b670226-2dc2-447d-b8be-a3a6b9e79460 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:17.024199 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-4c271132-6d42-460c-961f-a54e2bdd5e3e req-7b670226-2dc2-447d-b8be-a3a6b9e79460 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:17.027166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-4c271132-6d42-460c-961f-a54e2bdd5e3e req-7b670226-2dc2-447d-b8be-a3a6b9e79460 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:17.045805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-4c271132-6d42-460c-961f-a54e2bdd5e3e req-7b670226-2dc2-447d-b8be-a3a6b9e79460 service nova] Creating event network-changed:32463a74-b851-44eb-9dbb-f33e871b6327 for instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 on hv-cinder-85164 Aug 08 00:34:17.056009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-4c271132-6d42-460c-961f-a54e2bdd5e3e req-7b670226-2dc2-447d-b8be-a3a6b9e79460 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040770 Aug 08 00:34:17.056009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 98/203] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:34:17.681901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:17.682527 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:17.688958 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=4 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:17.692467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:17.692982 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:17.693551 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:17.694269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:17.694730 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:17.695160 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:17.778191 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:17.778191 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:17.795976 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:17.797497 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:17.799065 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:17.800855 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:17.802040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:17.804673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:17.935813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:17.946889 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-76fa900c-2755-4d92-bb91-9885e33f2e74 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1510 microversion: 2.1 time: 0.269782 Aug 08 00:34:17.949836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 106/204] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:17 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:17.970204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4a4ff877-94aa-4f71-8153-0dd59d2289d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:17.971821 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4a4ff877-94aa-4f71-8153-0dd59d2289d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:17.982530 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a4ff877-94aa-4f71-8153-0dd59d2289d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:17.984338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a4ff877-94aa-4f71-8153-0dd59d2289d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:17.988465 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a4ff877-94aa-4f71-8153-0dd59d2289d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:17.991750 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a4ff877-94aa-4f71-8153-0dd59d2289d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:17.992517 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a4ff877-94aa-4f71-8153-0dd59d2289d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:17.993449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a4ff877-94aa-4f71-8153-0dd59d2289d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:18.025745 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4a4ff877-94aa-4f71-8153-0dd59d2289d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/ips" status: 200 len: 152 microversion: 2.20 time: 0.074560 Aug 08 00:34:18.026406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 107/205] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Aug 8 00:34:17 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/ips => generated 152 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:34:18.068862 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:18.078376 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e57c6664-d31b-4733-af4c-4e814b5bcbb4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.315826 Aug 08 00:34:18.078957 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 99/206] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:17 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:18.971901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:18.973078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:18.979402 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:18.979885 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:18.980314 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:18.981119 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:18.981631 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:18.982213 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:19.099832 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:19.100530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:19.112839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:19.113401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:19.118808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:19.118808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:19.118808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:19.118808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:19.156084 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:19.167186 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fe704c99-2fce-4f83-9cc9-8b06c92e4c63 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1516 microversion: 2.1 time: 0.199081 Aug 08 00:34:19.175985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 108/207] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:18 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:19.381802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:19.394072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7d54e862-30f7-4336-afd6-bbea5b2f4f71 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.297996 Aug 08 00:34:19.395738 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 100/208] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:19 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:20.416445 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:20.418089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:20.426327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:20.426821 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:20.427264 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:20.443004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:20.443879 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:20.444260 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:20.598798 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:20.606287 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f8269bed-4349-476a-9244-2063d7720602 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.193516 Aug 08 00:34:20.610293 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 109/209] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:20 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:20.974881 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e82e24a3-95e8-4dc6-a208-90d589fc5117 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'create', calling method: .version_select at 0x7fd1a21335e0>, body: {"keypair": {"name": "tempest-keypair-910571370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrrkUfVF6Uy9buXu9UTY2r6w44ln42b7NGsP/rPTXb2nVdb+AsR1RDTZv3slQaDBy8BX6iEPBqUTg2nqQpJNdmqqw22divRQ3WRWybmmUHcC38XWz1GlX7MPZxzAuOk+A=="}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:20.980543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:20.981245 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=8 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:20.992799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-e82e24a3-95e8-4dc6-a208-90d589fc5117 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Getting quotas for project 9bd235f1f9f44df4b2e3dbd0c05b3a83. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:34:20.997868 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-e82e24a3-95e8-4dc6-a208-90d589fc5117 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Getting quotas for user c0aa06eea99f4011ab85ec51b0e60f2c and project 9bd235f1f9f44df4b2e3dbd0c05b3a83. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:34:21.078595 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:21.079157 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:21.086394 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:21.086877 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:21.087353 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:21.088060 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:21.088514 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:21.088944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:21.106327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e82e24a3-95e8-4dc6-a208-90d589fc5117 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135972 Aug 08 00:34:21.107249 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 101/210] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:34:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:34:21.122732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lazy-loading 'flavor' on Instance uuid 4829f58c-adec-413d-83c8-23f1d3143205 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:34:21.630826 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:21.631987 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:21.644542 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:21.645890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:21.645890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:21.646422 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:21.647043 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:21.647660 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:21.758870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-62dd0413-3c3f-4534-8059-f075e982b4b7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/action" status: 202 len: 0 microversion: 2.20 time: 0.684214 Aug 08 00:34:21.764808 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 110/211] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 8 00:34:21 2022] POST /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:34:21.771980 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:21.773336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:21.782288 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:21.783057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:21.783665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:21.785233 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:21.785233 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:21.786014 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:21.865654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:21.886311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-135de667-31dc-46c2-8c6e-ea1c4c6a933e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.260113 Aug 08 00:34:21.887947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 102/212] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:21 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:21.942834 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:21.951203 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:21.953096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:21.954395 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5a4d7203-9a8d-4b70-92e5-89749b5cbaf2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.188223 Aug 08 00:34:21.955152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 111/213] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:21 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:22.906893 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:22.910696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:22.916528 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:22.917024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:22.917449 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:22.918442 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:22.918938 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:22.919395 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:22.979396 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:22.980588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:22.995135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:23.000535 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:23.002301 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:23.003096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:23.004787 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:23.006781 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:23.193631 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:23.200254 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:23.202916 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:23.205944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:23.206574 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-aa4e8b33-5ce5-431f-a4ad-37d5a370032c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.232046 Aug 08 00:34:23.207146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 112/214] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:22 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:34:23.210060 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6a75d309-b6a3-4a77-a558-7d960d01cd7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.306945 Aug 08 00:34:23.211083 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 103/215] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:22 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:24.195349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-844148492", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39987f39-4c60-4c27-9f4f-c7657da06e51"}], "security_groups": [{"name": "tempest-securitygroup--2056342511"}], "key_name": "tempest-keypair-910571370", "user_data": "}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:24.233034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:24.237920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:24.247816 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:24.248701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:24.249667 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:24.250612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:24.251731 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:24.252840 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:24.340883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] validate_networks() for [('39987f39-4c60-4c27-9f4f-c7657da06e51', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:34:24.430230 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:24.439827 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:24.441802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:24.442998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6793a94b-badc-4db7-b7b7-06b91a38a462 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.216626 Aug 08 00:34:24.443933 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 104/216] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:24 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:24.448646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:24.449262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:24.455489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:24.455982 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:24.456425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:24.457120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:24.457764 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:24.458447 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:24.620030 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:24.630706 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f8ada0c3-faaa-4666-8ea3-bce71ef4fe4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.185639 Aug 08 00:34:24.631649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 105/217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:24 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:24.636758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-27d5f1c3-6500-40af-83af-ffca90a8969b req-4bb39c3c-00b6-48ed-9b4b-e3248d1c96ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728de657-b1e9-4f61-8dcf-d5cc9553eb16", "name": "network-vif-plugged", "status": "completed", "tag": "32463a74-b851-44eb-9dbb-f33e871b6327"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:24.646688 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-27d5f1c3-6500-40af-83af-ffca90a8969b req-4bb39c3c-00b6-48ed-9b4b-e3248d1c96ea service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:24.647552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-27d5f1c3-6500-40af-83af-ffca90a8969b req-4bb39c3c-00b6-48ed-9b4b-e3248d1c96ea service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:24.649637 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-27d5f1c3-6500-40af-83af-ffca90a8969b req-4bb39c3c-00b6-48ed-9b4b-e3248d1c96ea service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:24.655998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=100 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:24.664282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-27d5f1c3-6500-40af-83af-ffca90a8969b req-4bb39c3c-00b6-48ed-9b4b-e3248d1c96ea service nova] Creating event network-vif-plugged:32463a74-b851-44eb-9dbb-f33e871b6327 for instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 on hv-cinder-85164 Aug 08 00:34:24.670648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-27d5f1c3-6500-40af-83af-ffca90a8969b req-4bb39c3c-00b6-48ed-9b4b-e3248d1c96ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037646 Aug 08 00:34:24.671285 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 106/218] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:34:24.836279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:34:24.837078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:34:24.837784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:34:24.838553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:34:24.839128 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:34:24.850865 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:24.851397 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:24.851830 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:24.852585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:24.853273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:24.853707 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:24.878591 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Getting quotas for project 9bd235f1f9f44df4b2e3dbd0c05b3a83. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:34:24.883274 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Getting quotas for user c0aa06eea99f4011ab85ec51b0e60f2c and project 9bd235f1f9f44df4b2e3dbd0c05b3a83. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:34:24.894855 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:34:24.897150 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:34:25.038021 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-adf4e4b5-3277-4c4a-a715-83bb006afdfd tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.846822 Aug 08 00:34:25.038672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 113/219] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:34:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:34:25.053958 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a8cb5207-9c62-418f-90e3-934c54323685 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:25.054728 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a8cb5207-9c62-418f-90e3-934c54323685 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:25.127606 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a8cb5207-9c62-418f-90e3-934c54323685 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:25.134298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a8cb5207-9c62-418f-90e3-934c54323685 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1244 microversion: 2.1 time: 0.085752 Aug 08 00:34:25.134928 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 107/220] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:25 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:25.466397 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:25.467002 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:25.474414 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:25.474903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:25.475486 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:25.476185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:25.476638 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:25.477065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:25.616561 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:25.624692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:25.626177 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:25.627418 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1a3ecc2d-b837-41f4-b5f4-7f729e485b6d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.165075 Aug 08 00:34:25.627995 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 114/221] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:25 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:25.656228 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:25.657334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:25.669451 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:25.669451 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:25.669451 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:25.669451 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:25.669761 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:25.669761 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:25.807600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:25.815640 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8bf6b846-cdf6-421d-b453-281aa83e43b4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.165845 Aug 08 00:34:25.816146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 108/222] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:25 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:26.154841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:26.155495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:26.161921 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:26.162396 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:26.162828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:26.163535 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:26.163995 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:26.164411 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:26.233464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:26.254986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6ffdf496-2a29-4141-917c-f19e28375abc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1248 microversion: 2.1 time: 0.103811 Aug 08 00:34:26.255925 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 115/223] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:26 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1248 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:26.656043 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:26.656639 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:26.665185 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:26.675113 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:26.675390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:26.676452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:26.676952 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:26.677384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:26.838632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:26.839202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:26.846886 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:26.847634 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:26.848096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:26.848793 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:26.849252 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:26.849678 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:26.995693 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:27.002951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:27.004511 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:27.005561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0f5022b9-dfe7-4b3e-93b4-4e39ff2d87dc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.359402 Aug 08 00:34:27.011477 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 109/224] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:26 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:27.064986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:27.074700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-01e6648e-6ebb-4425-acb6-52e15642eb33 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1368 microversion: 2.1 time: 0.240986 Aug 08 00:34:27.075319 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 116/225] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:26 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:27.280662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:27.281309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:27.288019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:27.288496 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:27.288931 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:27.289632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:27.290077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:27.290676 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:27.389355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:27.398647 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-77d4fe25-f3de-46c5-a7ad-94d7ea162e69 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1240 microversion: 2.1 time: 0.122912 Aug 08 00:34:27.399279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 110/226] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:27 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:28.030351 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:28.030987 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:28.037197 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:28.037677 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:28.038109 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:28.038790 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:28.039264 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:28.039690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:28.097016 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:28.097562 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:28.104258 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:28.105210 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:28.105210 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:28.106103 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:28.106491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:28.107117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:28.178632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:28.187298 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:28.188761 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:28.194012 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-7d4aa7ba-aeb7-4d97-b075-041a7b0f58b1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.163592 Aug 08 00:34:28.194012 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 117/227] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:28 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:28.268987 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:28.276571 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-514dd4b5-cc5e-4732-97fa-c71b0c52e663 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1558 microversion: 2.1 time: 0.183919 Aug 08 00:34:28.277203 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 111/228] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:28 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:28.299629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3bb4ad61-f2ab-4ad0-8a1a-ab509b0b4f4a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:28.300349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3bb4ad61-f2ab-4ad0-8a1a-ab509b0b4f4a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:28.307891 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bb4ad61-f2ab-4ad0-8a1a-ab509b0b4f4a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:28.308574 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bb4ad61-f2ab-4ad0-8a1a-ab509b0b4f4a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:28.309385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bb4ad61-f2ab-4ad0-8a1a-ab509b0b4f4a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:28.310405 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bb4ad61-f2ab-4ad0-8a1a-ab509b0b4f4a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:28.311061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bb4ad61-f2ab-4ad0-8a1a-ab509b0b4f4a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:28.311691 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bb4ad61-f2ab-4ad0-8a1a-ab509b0b4f4a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:28.410322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3bb4ad61-f2ab-4ad0-8a1a-ab509b0b4f4a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116365 Aug 08 00:34:28.420590 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 118/229] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 00:34:28 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:34:28.421297 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:28.421901 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:28.424930 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:28.431443 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:28.432360 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:28.433019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:28.434180 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:28.434841 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:28.435533 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:28.505085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:28.515216 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5e4783be-9b68-4224-aae6-e20b7d1f234a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1296 microversion: 2.1 time: 0.097754 Aug 08 00:34:28.516473 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 112/230] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:28 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:29.214782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:29.216216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:29.234816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:29.235778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:29.238283 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:29.244904 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:29.245433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:29.246119 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:29.489266 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:29.493883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:29.498212 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:29.499680 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:29.500852 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6a4a3406-fd9a-4ac9-b9f6-176b1d50e91e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.290406 Aug 08 00:34:29.502481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 119/231] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:29 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:29.537626 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:29.538434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:29.557613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:29.558009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:29.558440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:29.559137 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:29.559612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:29.560030 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:29.621802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:29.631345 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-63ee62e0-f4c0-4b95-88b9-617bac892489 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1296 microversion: 2.1 time: 0.097577 Aug 08 00:34:29.634096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 113/232] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:29 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:30.023783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-b41d5fac-c600-4c04-a89c-650a39e1daeb req-236d879d-ca71-4b46-b1de-687c68ef1ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728de657-b1e9-4f61-8dcf-d5cc9553eb16", "tag": "32463a74-b851-44eb-9dbb-f33e871b6327"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:30.034089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b41d5fac-c600-4c04-a89c-650a39e1daeb req-236d879d-ca71-4b46-b1de-687c68ef1ed2 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:30.034683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b41d5fac-c600-4c04-a89c-650a39e1daeb req-236d879d-ca71-4b46-b1de-687c68ef1ed2 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:30.035149 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b41d5fac-c600-4c04-a89c-650a39e1daeb req-236d879d-ca71-4b46-b1de-687c68ef1ed2 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:30.046354 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-b41d5fac-c600-4c04-a89c-650a39e1daeb req-236d879d-ca71-4b46-b1de-687c68ef1ed2 service nova] Creating event network-changed:32463a74-b851-44eb-9dbb-f33e871b6327 for instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 on hv-cinder-85164 Aug 08 00:34:30.052174 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-b41d5fac-c600-4c04-a89c-650a39e1daeb req-236d879d-ca71-4b46-b1de-687c68ef1ed2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032250 Aug 08 00:34:30.052770 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 120/233] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:34:30.526215 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:30.527167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:30.536475 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:30.539466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:30.539466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:30.539466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:30.539466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:30.540591 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:30.660166 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:30.661790 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:30.684442 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:30.685398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:30.686156 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:30.688134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:30.690646 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:30.692252 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:30.901401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:30.915520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5c623f36-2d7a-4fd5-aad0-d4a6304821d4 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1304 microversion: 2.1 time: 0.262600 Aug 08 00:34:30.916506 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 121/234] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:30 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1304 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:31.200844 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:31.209846 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:31.211369 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:31.212581 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1d204c49-cf8a-49d4-b992-4076a922e281 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.690740 Aug 08 00:34:31.213162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 114/235] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:30 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:31.951208 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:31.959493 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:31.961098 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:31.961769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:31.962368 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:31.963567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:31.964333 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:31.964911 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:32.184931 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:32.192812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bc866d16-3060-4dad-9ceb-c274ccb42d00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1370 microversion: 2.1 time: 0.246714 Aug 08 00:34:32.193593 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 122/236] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:31 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:32.236742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:32.237349 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:32.243947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:32.244425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:32.244862 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:32.245564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:32.246015 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:32.246441 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:32.406451 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:32.418617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:32.420427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:32.421890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c5865ab3-0eb6-4bf9-9fe1-394469b7774a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.189702 Aug 08 00:34:32.422502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 115/237] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:32 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:32.901921 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-25fbdbe0-85dc-408d-9a03-851b9b24c14a req-39835f9d-81e8-4eab-8211-1c732cb1b7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8220eb97-0920-4393-9354-094c2f62cc94", "tag": "bd00c5d4-343c-4fc4-b81d-fc55458cef59"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:32.912651 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-25fbdbe0-85dc-408d-9a03-851b9b24c14a req-39835f9d-81e8-4eab-8211-1c732cb1b7fb service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:32.918712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-25fbdbe0-85dc-408d-9a03-851b9b24c14a req-39835f9d-81e8-4eab-8211-1c732cb1b7fb service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:32.918712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-25fbdbe0-85dc-408d-9a03-851b9b24c14a req-39835f9d-81e8-4eab-8211-1c732cb1b7fb service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:32.927024 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-25fbdbe0-85dc-408d-9a03-851b9b24c14a req-39835f9d-81e8-4eab-8211-1c732cb1b7fb service nova] Creating event network-changed:bd00c5d4-343c-4fc4-b81d-fc55458cef59 for instance 8220eb97-0920-4393-9354-094c2f62cc94 on hv-cinder-85164 Aug 08 00:34:32.931984 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-25fbdbe0-85dc-408d-9a03-851b9b24c14a req-39835f9d-81e8-4eab-8211-1c732cb1b7fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033968 Aug 08 00:34:32.932588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 123/238] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:34:33.214417 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:33.215059 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:33.222230 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:33.222636 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:33.223070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:33.223891 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:33.224340 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:33.224763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:33.363614 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:33.371377 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-bc7aa0d3-1da8-4dca-afb7-8ba8fcb7486a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1370 microversion: 2.1 time: 0.160844 Aug 08 00:34:33.371950 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 116/239] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:33 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:33.446562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:33.455001 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:33.461353 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:33.461836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:33.462285 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:33.463190 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:33.463835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:33.467992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:33.681915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:33.691501 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:33.693538 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:33.694317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-461e0819-1f53-4407-b646-f70248040c99 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.252138 Aug 08 00:34:33.694882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 124/240] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:33 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:34.394392 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:34.395082 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:34.401582 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:34.402129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:34.402541 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:34.403308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:34.403771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:34.404254 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:34.539039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:34.549506 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-42c0d047-0ca8-403f-8a4a-fdd9f42aabe7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1370 microversion: 2.1 time: 0.157686 Aug 08 00:34:34.549506 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 117/241] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:34 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:34.718098 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:34.719362 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:34.725647 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:34.726134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:34.726568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:34.727362 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:34.727821 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:34.728258 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:34.864735 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:34.890518 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=6 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:34.894278 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:34.902996 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:34.904561 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:34.905812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1b19e84b-8ea6-40d1-af99-1e32fc0f25f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.191668 Aug 08 00:34:34.906679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 125/242] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:34 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:35.569413 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:35.570015 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:35.571916 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:35.577057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:35.577534 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:35.578006 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:35.578687 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:35.579640 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:35.580067 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:35.722824 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:35.730570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6d976bf9-2bc4-4548-8826-870407a32abb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1370 microversion: 2.1 time: 0.164980 Aug 08 00:34:35.731151 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 118/243] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:35 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:35.930180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:35.930812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:35.937200 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:35.937680 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:35.938134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:35.939398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:35.940056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:35.940486 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:36.070632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:36.078566 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:36.080142 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:36.081329 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-05c496d5-a61d-4451-bddc-7d1a5c089d40 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.155614 Aug 08 00:34:36.081884 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 126/244] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:35 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:36.751470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:36.752116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:36.758991 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:36.759522 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:36.759945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:36.760638 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:36.761088 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:36.761512 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:36.988828 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:36.996582 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c0df5b19-4662-45ce-a9ed-d5c758a930d5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1370 microversion: 2.1 time: 0.249043 Aug 08 00:34:36.997149 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 119/245] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:36 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:37.104522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:37.105131 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:37.111499 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:37.111990 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:37.112431 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:37.113129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:37.113586 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:37.114010 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:37.254615 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:37.264973 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:37.267821 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:37.269261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fa384a72-e62c-432b-b71f-3ce3b77e1a5f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.168625 Aug 08 00:34:37.270164 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 127/246] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:37 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:38.017711 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:38.018481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:38.025109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:38.025593 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:38.026031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:38.026730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:38.027266 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:38.027617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:38.158367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:38.166249 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0e63578a-b415-42b1-b5c2-1af04e32de49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1370 microversion: 2.1 time: 0.152391 Aug 08 00:34:38.166943 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 120/247] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:38 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:34:38.293768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:38.294380 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:38.301951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:38.302461 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:38.302955 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:38.305029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:38.305029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:38.305029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:38.476482 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:38.488203 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:38.491249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:38.492688 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e72a6588-e638-41d6-9c49-4deac6bbedef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.203026 Aug 08 00:34:38.498074 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 128/248] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:38 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:39.188027 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:39.189342 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:39.195824 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:39.196304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:39.196740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:39.197441 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:39.197895 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:39.198317 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:39.353663 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:39.355680 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-46cd2181-99c2-4788-a4ff-43d995c80bda tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1370 microversion: 2.1 time: 0.171587 Aug 08 00:34:39.356249 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 121/249] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:39 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:39.524729 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:39.526748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:39.535304 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:39.543259 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:39.543751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:39.548555 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:39.549177 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:39.549960 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:39.550396 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:39.608301 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-c6127208-2b06-474e-8889-9dd4ffb9634a req-828d209f-5361-4eb5-bba2-2f7f3c319d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8220eb97-0920-4393-9354-094c2f62cc94", "name": "network-vif-plugged", "status": "completed", "tag": "bd00c5d4-343c-4fc4-b81d-fc55458cef59"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:39.622044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-c6127208-2b06-474e-8889-9dd4ffb9634a req-828d209f-5361-4eb5-bba2-2f7f3c319d71 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:39.622832 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-c6127208-2b06-474e-8889-9dd4ffb9634a req-828d209f-5361-4eb5-bba2-2f7f3c319d71 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:39.623709 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-c6127208-2b06-474e-8889-9dd4ffb9634a req-828d209f-5361-4eb5-bba2-2f7f3c319d71 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:39.637787 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-c6127208-2b06-474e-8889-9dd4ffb9634a req-828d209f-5361-4eb5-bba2-2f7f3c319d71 service nova] Creating event network-vif-plugged:bd00c5d4-343c-4fc4-b81d-fc55458cef59 for instance 8220eb97-0920-4393-9354-094c2f62cc94 on hv-cinder-85164 Aug 08 00:34:39.652342 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-c6127208-2b06-474e-8889-9dd4ffb9634a req-828d209f-5361-4eb5-bba2-2f7f3c319d71 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045131 Aug 08 00:34:39.653152 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 122/250] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:34:39.836578 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:39.844849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:39.847187 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:39.848456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bc91b512-3f2c-48ef-88a1-df883569dde9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.335586 Aug 08 00:34:39.849000 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 129/251] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:39 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:40.378465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:40.379883 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:40.387375 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:40.388151 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:40.388595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:40.389315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:40.389771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:40.390196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:40.539064 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:40.550174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ba282363-3b2e-4cfd-8d6a-94ebca31ea03 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1370 microversion: 2.1 time: 0.176896 Aug 08 00:34:40.562701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 123/252] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:40 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:40.871579 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:40.872290 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:40.879585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:40.883004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:40.883004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:40.883004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:40.883004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:40.883425 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:41.013417 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:41.027864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:41.029382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:41.030693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d2fc254d-87f6-45dc-a4cf-7db20883489a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.162978 Aug 08 00:34:41.031284 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 130/253] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:40 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:41.577625 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:41.580026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:41.588181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:41.596260 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:41.596260 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:41.596260 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:41.596260 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:41.596724 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:41.873210 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:41.881897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8e05bca3-4e87-43aa-a592-33dea501f6ba tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1370 microversion: 2.1 time: 0.312979 Aug 08 00:34:41.882510 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 124/254] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:41 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:42.055530 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:42.056091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:42.062835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:42.064019 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:42.064528 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:42.065231 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:42.065678 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:42.066111 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:42.262959 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:42.276931 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:42.278437 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:42.279709 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cc16499e-615c-435a-8bbe-51049019a3f2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.229069 Aug 08 00:34:42.283460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 131/255] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:42 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:34:42.905944 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:42.906606 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:42.917363 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:42.918117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:42.918574 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:42.919584 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:42.920414 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:42.921195 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:42.926556 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=100 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:43.305271 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:43.305876 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:43.311909 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:43.312387 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:43.316198 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:43.316198 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:43.316198 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:43.316198 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:43.372199 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:43.384904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-44776332-734d-4f56-803b-c78159610bff tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1564 microversion: 2.1 time: 0.483485 Aug 08 00:34:43.399275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 125/256] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:34:42 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1564 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:34:43.407947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-913159be-401d-410d-9bf6-127b87c12002 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:43.409136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-913159be-401d-410d-9bf6-127b87c12002 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:43.415428 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-913159be-401d-410d-9bf6-127b87c12002 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:43.415920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-913159be-401d-410d-9bf6-127b87c12002 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:43.416381 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-913159be-401d-410d-9bf6-127b87c12002 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:43.420095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-913159be-401d-410d-9bf6-127b87c12002 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:43.420095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-913159be-401d-410d-9bf6-127b87c12002 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:43.420095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-913159be-401d-410d-9bf6-127b87c12002 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:43.473954 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:43.482827 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:43.487407 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:43.488801 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-16a9382f-f9ba-4eec-a4e2-25ef5fe4ab4d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1746 microversion: 2.20 time: 0.188673 Aug 08 00:34:43.491293 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 132/257] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:43 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1746 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:34:43.559695 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-913159be-401d-410d-9bf6-127b87c12002 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156425 Aug 08 00:34:43.560303 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 126/258] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 00:34:43 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:34:44.511943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:44.512846 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:44.525510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:44.525998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:44.526423 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:44.527303 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:44.527902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:44.528459 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:44.808273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:44.820220 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:44.822675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:44.825094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-43b19f5a-84f2-470a-81c8-4b3272b73a0c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1746 microversion: 2.20 time: 0.316350 Aug 08 00:34:44.827052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 133/259] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:44 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1746 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:44.957069 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-f56e17e6-013c-4d80-8c81-08f59930a06b req-0f12a4ca-f8fc-4bc3-a870-ec6d5e078ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8220eb97-0920-4393-9354-094c2f62cc94", "tag": "bd00c5d4-343c-4fc4-b81d-fc55458cef59"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:44.971816 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-f56e17e6-013c-4d80-8c81-08f59930a06b req-0f12a4ca-f8fc-4bc3-a870-ec6d5e078ae2 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:44.972769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-f56e17e6-013c-4d80-8c81-08f59930a06b req-0f12a4ca-f8fc-4bc3-a870-ec6d5e078ae2 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:44.973551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-f56e17e6-013c-4d80-8c81-08f59930a06b req-0f12a4ca-f8fc-4bc3-a870-ec6d5e078ae2 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:44.987600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-f56e17e6-013c-4d80-8c81-08f59930a06b req-0f12a4ca-f8fc-4bc3-a870-ec6d5e078ae2 service nova] Creating event network-changed:bd00c5d4-343c-4fc4-b81d-fc55458cef59 for instance 8220eb97-0920-4393-9354-094c2f62cc94 on hv-cinder-85164 Aug 08 00:34:44.993972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-f56e17e6-013c-4d80-8c81-08f59930a06b req-0f12a4ca-f8fc-4bc3-a870-ec6d5e078ae2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045626 Aug 08 00:34:44.994675 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 127/260] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:34:45.851856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:45.852742 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:45.865286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:45.865807 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:45.866236 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:45.866985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:45.867471 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:45.872728 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:46.610359 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:46.625167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:46.628814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:46.632636 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-96e5742e-b0d4-4f6f-a071-245ea4541291 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1746 microversion: 2.20 time: 0.785842 Aug 08 00:34:46.634470 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 134/261] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:45 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1746 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:47.282560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-28f8da2b-0b6e-4301-9226-1ee365f65503 req-b6fddbd0-8966-4bf2-83c6-631a5c8c3015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4829f58c-adec-413d-83c8-23f1d3143205", "name": "network-vif-plugged", "status": "completed", "tag": "424b2123-2ed7-4eda-bdcf-dd72a3df7bea"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:47.324250 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-28f8da2b-0b6e-4301-9226-1ee365f65503 req-b6fddbd0-8966-4bf2-83c6-631a5c8c3015 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:47.333813 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-28f8da2b-0b6e-4301-9226-1ee365f65503 req-b6fddbd0-8966-4bf2-83c6-631a5c8c3015 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:47.333813 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-28f8da2b-0b6e-4301-9226-1ee365f65503 req-b6fddbd0-8966-4bf2-83c6-631a5c8c3015 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:47.371014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-28f8da2b-0b6e-4301-9226-1ee365f65503 req-b6fddbd0-8966-4bf2-83c6-631a5c8c3015 service nova] Creating event network-vif-plugged:424b2123-2ed7-4eda-bdcf-dd72a3df7bea for instance 4829f58c-adec-413d-83c8-23f1d3143205 on hv-cinder-85164 Aug 08 00:34:47.387265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-28f8da2b-0b6e-4301-9226-1ee365f65503 req-b6fddbd0-8966-4bf2-83c6-631a5c8c3015 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113427 Aug 08 00:34:47.388805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 128/262] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:34:47.658448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:47.659701 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:47.681610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:47.682207 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:47.685218 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:47.687623 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:47.688912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:47.690308 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:48.006627 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:48.015687 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:48.018102 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:48.019977 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2d2613f6-73ef-46ca-9074-65fb913845f7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.366451 Aug 08 00:34:48.024237 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 135/263] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:47 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:49.050046 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:49.050046 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:49.064516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:49.065251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:49.065728 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:49.068135 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:49.069164 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:49.070317 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:49.324891 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:49.337332 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:49.348569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:49.348569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1775d421-d772-47ed-be3c-46ae140de805 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.303871 Aug 08 00:34:49.348569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 129/264] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:49 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:50.377538 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:50.378153 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:50.398409 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:50.403786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:50.404153 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:50.408185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:50.408542 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:50.408981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:50.864840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:50.880800 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:50.883897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:50.887743 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-39f99f4a-84d9-46d9-9f3d-6de8ee68a139 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.515692 Aug 08 00:34:50.891281 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 136/265] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:50 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:51.914005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:51.914620 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:51.937629 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:51.939835 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:51.940344 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:51.941102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:51.941698 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:51.942128 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:52.307494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:52.322692 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:52.332491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:52.334023 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ee7e593a-e987-4730-9626-c46a31724502 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.424251 Aug 08 00:34:52.335014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 130/266] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:51 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:53.363484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:53.363484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:53.370967 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:53.376854 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:53.377794 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:53.378532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:53.384289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:53.384289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:53.769584 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:53.780101 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=100 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:34:53.802698 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:53.810757 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:53.814698 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-574f28bb-1549-4100-94b4-4913c981be8f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.458816 Aug 08 00:34:53.818532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 137/267] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:53 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:54.849251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:54.850730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:54.865077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:54.865792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:54.869427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:54.870212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:54.870689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:54.871124 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:55.415977 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:55.436029 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:55.439315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:55.442067 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-68cd52c3-f556-42f1-9c99-fe60e49aee0d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.597225 Aug 08 00:34:55.447910 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 131/268] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:54 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:56.475265 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:56.476636 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:56.498157 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:56.499058 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:56.505230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:56.505230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:56.505230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:56.505230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:56.729582 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:56.741836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:56.743682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:56.745621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9ef0aae1-9ad3-46e8-ba45-d97b9c3253ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.275807 Aug 08 00:34:56.751581 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 138/269] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:56 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:57.772024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:57.773860 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:57.829689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:57.837067 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:57.838361 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:57.844386 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:57.849822 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:57.853452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:58.271309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:58.287084 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:58.290204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:58.291518 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b6e3507c-6e68-49c8-81ef-291f0a37e815 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.524503 Aug 08 00:34:58.306487 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 132/270] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:57 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:34:59.163474 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-607648815", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:34:59.216944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] validate_networks() for None {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:34:59.323957 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:34:59.325782 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:34:59.336848 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:59.337832 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:59.338298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:59.340105 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:59.340563 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:59.343879 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:59.620507 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:34:59.622816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:34:59.622816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:34:59.622816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:34:59.622816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:34:59.643826 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:59.645802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:59.645802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:59.647326 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:34:59.648173 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:34:59.648828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:34:59.670206 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Getting quotas for project 0fb873acb9dc45d98bb0ccde8ee50a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:34:59.690738 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Getting quotas for user 9f87028b4b624ebb829a4b61da5f9b9d and project 0fb873acb9dc45d98bb0ccde8ee50a5a. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:34:59.725484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:34:59.734662 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:34:59.983699 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:59.997085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:34:59.998777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:00.004657 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c13b94c6-174c-4fa2-94cc-ceee118449d0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.693187 Aug 08 00:35:00.011265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 133/271] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:34:59 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:00.011456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cea55e41-e254-4e2e-a01e-9b25c323bdd7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848450 Aug 08 00:35:00.022045 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-07ed7c0b-2645-4539-b6d4-0dd32a8dd96f tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:00.026771 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 139/272] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:35:00.027316 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-07ed7c0b-2645-4539-b6d4-0dd32a8dd96f tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:00.144392 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-07ed7c0b-2645-4539-b6d4-0dd32a8dd96f tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:00.157852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-07ed7c0b-2645-4539-b6d4-0dd32a8dd96f tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1214 microversion: 2.1 time: 0.138192 Aug 08 00:35:00.159050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 134/273] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:00 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:01.042184 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:01.042827 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:01.058837 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:01.059631 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:01.060432 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:01.061428 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:01.062907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:01.063651 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:01.181783 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a0af2e59-9778-48fa-8672-60b1f3b88057 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:01.187020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a0af2e59-9778-48fa-8672-60b1f3b88057 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:01.189837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=48 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:01.287134 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a0af2e59-9778-48fa-8672-60b1f3b88057 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:01.287935 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:01.296543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a0af2e59-9778-48fa-8672-60b1f3b88057 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1214 microversion: 2.1 time: 0.119420 Aug 08 00:35:01.299244 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 135/274] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:01 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:01.309961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:01.316816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:01.329778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-be94f524-6cfb-47b9-9464-20f0a1f4dbfb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.287270 Aug 08 00:35:01.334637 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 140/275] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:01 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:02.322626 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:02.323608 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:02.333335 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:02.334514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:02.335763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:02.336821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:02.337669 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:02.338201 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:02.357092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:02.360555 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:02.388289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:02.389279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:02.389851 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:02.391062 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:02.391743 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:02.393568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:02.964767 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:02.975510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:02.978163 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:02.979289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:02.980491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ba823e2a-1b6a-4068-96da-73c80c29fc80 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.627444 Aug 08 00:35:02.987424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 141/276] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:02 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:35:02.992063 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-625d2a3e-3419-4a3f-83c7-9bf988ada809 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1218 microversion: 2.1 time: 0.675636 Aug 08 00:35:02.992664 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 136/277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:02 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1218 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:04.012400 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:04.014289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:04.021299 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:04.021913 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:04.041564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:04.042079 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:04.042306 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:04.042873 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:04.043361 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:04.044682 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:04.045520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:04.047152 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:04.047884 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:04.048297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:04.048923 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:04.052587 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:04.296886 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:04.311823 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4be48d7e-8ef1-47ee-8503-bd092ccecdfd tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1266 microversion: 2.1 time: 0.291178 Aug 08 00:35:04.315706 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 137/278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:04 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:04.900892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:04.910687 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:04.917826 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:04.919935 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0bd53a94-bfb3-4244-a82c-68fc092fc603 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.912793 Aug 08 00:35:04.923335 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 142/279] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:04 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:05.336447 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:05.338633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:05.378190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:05.378698 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:05.379141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:05.384042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:05.384539 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:05.384959 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:05.639922 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:05.652220 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c2562fa5-0b2a-4796-abc6-66c7e290da05 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1272 microversion: 2.1 time: 0.321198 Aug 08 00:35:05.666379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 138/280] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:05 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:05.946263 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:05.947687 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:05.974190 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:05.974964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:05.975671 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:05.980036 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:05.986132 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:05.997885 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:06.675206 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:06.679090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:06.697005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:06.698288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:06.698288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:06.698551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:06.711863 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:06.716227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:06.883735 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:06.914706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:06.916394 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:06.922693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-13a4dd2d-cd7c-4406-ac10-41f917782228 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 0.980471 Aug 08 00:35:06.944632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 143/281] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:05 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:07.475559 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:07.492702 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c02f41bc-82ae-4e07-bd60-93905bd7f840 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1314 microversion: 2.1 time: 0.817621 Aug 08 00:35:07.492702 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 139/282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:06 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:07.966061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:07.967468 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:07.988388 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:07.989698 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:07.994724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:07.995773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:08.003979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:08.004966 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:08.510213 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:08.510857 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:08.524995 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:08.525957 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:08.526646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:08.527766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:08.528441 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:08.529101 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:08.866403 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:08.877665 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-af464f71-e0ae-4d58-9f57-b5cd45ba3be2 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1314 microversion: 2.1 time: 0.370831 Aug 08 00:35:08.888570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 140/283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:08 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:09.166418 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:09.181593 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:09.195936 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:09.195936 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2196cb79-76a3-4472-8ebf-faa898e37461 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1741 microversion: 2.20 time: 1.222371 Aug 08 00:35:09.195936 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 144/284] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:07 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1741 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:09.912793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:09.913407 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:09.926156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:09.926653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:09.927087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:09.930113 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:09.944022 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:09.944655 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:09.949039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-87534149-b765-4e3a-bc35-ddba5cea6bf1 req-8b460164-ed19-4db1-8190-5323d358d42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abceacff-4197-477c-99d2-090dbe5727e4", "tag": "b04c5d59-5942-49e6-af63-74888b176926"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:09.984775 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:09.985732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=6 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:09.988130 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-87534149-b765-4e3a-bc35-ddba5cea6bf1 req-8b460164-ed19-4db1-8190-5323d358d42c service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:09.988626 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-87534149-b765-4e3a-bc35-ddba5cea6bf1 req-8b460164-ed19-4db1-8190-5323d358d42c service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:09.989133 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-87534149-b765-4e3a-bc35-ddba5cea6bf1 req-8b460164-ed19-4db1-8190-5323d358d42c service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:10.029492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-87534149-b765-4e3a-bc35-ddba5cea6bf1 req-8b460164-ed19-4db1-8190-5323d358d42c service nova] Creating event network-changed:b04c5d59-5942-49e6-af63-74888b176926 for instance abceacff-4197-477c-99d2-090dbe5727e4 on hv-cinder-85164 Aug 08 00:35:10.041979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-87534149-b765-4e3a-bc35-ddba5cea6bf1 req-8b460164-ed19-4db1-8190-5323d358d42c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101643 Aug 08 00:35:10.045080 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 145/285] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:10.244174 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:10.248252 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:10.287481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:10.314065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:10.314065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:10.314065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:10.314065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:10.314492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:10.727973 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:10.738061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:10.739817 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:10.741327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-00c436eb-aed8-471e-a431-3a407fb3cc53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1723 microversion: 2.20 time: 0.510569 Aug 08 00:35:10.742100 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 146/286] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:10 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:35:10.807927 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:10.818106 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-777f58cf-d2cc-4eb0-abec-7c19233c82fc tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1314 microversion: 2.1 time: 0.919957 Aug 08 00:35:10.819296 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 141/287] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:09 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:11.767023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:11.767648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:11.777610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:11.778446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:11.779095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:11.780329 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:11.781370 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:11.782065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:11.845380 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:11.846172 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:11.848434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=4 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:11.867370 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:11.868151 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:11.868586 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:11.869310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:11.869759 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:11.870184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:12.132429 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:12.144126 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:12.152907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:12.156613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-38c5a0bc-817f-466e-b374-7eec103013df tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1723 microversion: 2.20 time: 0.394542 Aug 08 00:35:12.161540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 147/288] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:11 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:12.294509 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:12.303973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b45486a6-045b-4f5d-bc84-d418e03574f8 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1314 microversion: 2.1 time: 0.463901 Aug 08 00:35:12.305127 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 142/289] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:11 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:13.189240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:13.189856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:13.191920 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:13.207253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:13.208314 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:13.208753 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:13.209760 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:13.210209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:13.210631 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:13.335499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:13.335499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:13.355826 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:13.356853 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:13.357604 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:13.359016 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:13.359510 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:13.360206 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:13.552354 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:13.562165 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:13.566223 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:13.566223 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-40406c88-3cd0-4827-a35f-ec48412a9a83 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1723 microversion: 2.20 time: 0.380059 Aug 08 00:35:13.569534 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:13.581699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 148/290] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:13 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:13.587816 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-be97eb47-cd3f-4311-a173-a4cbf0484e35 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1314 microversion: 2.1 time: 0.263008 Aug 08 00:35:13.589742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 143/291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:13 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:14.312265 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-b3402ba0-87a0-4782-907e-29c7de870804 req-dbbf9204-d3a7-45cf-bfc7-b58f34e7bb4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4829f58c-adec-413d-83c8-23f1d3143205", "name": "network-vif-unplugged", "status": "completed", "tag": "424b2123-2ed7-4eda-bdcf-dd72a3df7bea"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:14.329949 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b3402ba0-87a0-4782-907e-29c7de870804 req-dbbf9204-d3a7-45cf-bfc7-b58f34e7bb4b service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:14.333902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b3402ba0-87a0-4782-907e-29c7de870804 req-dbbf9204-d3a7-45cf-bfc7-b58f34e7bb4b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:14.333902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b3402ba0-87a0-4782-907e-29c7de870804 req-dbbf9204-d3a7-45cf-bfc7-b58f34e7bb4b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:14.345872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-b3402ba0-87a0-4782-907e-29c7de870804 req-dbbf9204-d3a7-45cf-bfc7-b58f34e7bb4b service nova] Creating event network-vif-unplugged:424b2123-2ed7-4eda-bdcf-dd72a3df7bea for instance 4829f58c-adec-413d-83c8-23f1d3143205 on hv-cinder-85164 Aug 08 00:35:14.352155 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-b3402ba0-87a0-4782-907e-29c7de870804 req-dbbf9204-d3a7-45cf-bfc7-b58f34e7bb4b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044533 Aug 08 00:35:14.353049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 149/292] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:14.593255 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:14.593859 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:14.612066 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:14.614145 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:14.614896 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:14.616077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:14.617882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:14.618708 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:14.619834 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:14.620496 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:14.631786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:14.637782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:14.637782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:14.637782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:14.637782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:14.638581 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:14.949509 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:14.960120 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-006a09d6-5ce9-431b-b8fb-931c6e920aba tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1314 microversion: 2.1 time: 0.346467 Aug 08 00:35:14.975723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 150/293] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:14 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:15.036078 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:15.038484 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=95 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:15.051365 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:15.055653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:15.062616 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-54fd71ff-3522-45a2-ae63-9f801fb3783a tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1723 microversion: 2.20 time: 0.474238 Aug 08 00:35:15.073582 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 144/294] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:14 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1723 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:15.982176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:15.984382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:15.994798 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:15.995413 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:15.996048 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:15.996972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:15.997613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:15.998190 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:16.099823 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:16.100543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:16.115976 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:16.116873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:16.118494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:16.120408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:16.123600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:16.123600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:16.235424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:16.250952 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2cd9f172-0bb5-4868-a82a-10003e3f3fdb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1314 microversion: 2.1 time: 0.272585 Aug 08 00:35:16.256593 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 151/295] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:15 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:16.325042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:16.336709 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:16.349366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:16.353121 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9312589d-3209-4565-93c7-8e0ccfa315d3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1726 microversion: 2.20 time: 0.259269 Aug 08 00:35:16.354296 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 145/296] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:16 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1726 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:16.385971 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-74c3401b-d3ab-408b-903e-4ec62b3e73ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cde507e3-a658-4b99-83f0-19cdbc96dca5"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:16.388395 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-74c3401b-d3ab-408b-903e-4ec62b3e73ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:16.400937 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74c3401b-d3ab-408b-903e-4ec62b3e73ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:16.401477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74c3401b-d3ab-408b-903e-4ec62b3e73ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:16.409676 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74c3401b-d3ab-408b-903e-4ec62b3e73ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:16.411192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74c3401b-d3ab-408b-903e-4ec62b3e73ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:16.411771 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74c3401b-d3ab-408b-903e-4ec62b3e73ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:16.412307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74c3401b-d3ab-408b-903e-4ec62b3e73ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:16.972954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-2be61fe6-4434-4d73-9d8e-6c928e27f567 req-08cb2f66-9ad0-4f68-bc9f-8c9ee1808f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abceacff-4197-477c-99d2-090dbe5727e4", "name": "network-vif-plugged", "status": "completed", "tag": "b04c5d59-5942-49e6-af63-74888b176926"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:17.000551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2be61fe6-4434-4d73-9d8e-6c928e27f567 req-08cb2f66-9ad0-4f68-bc9f-8c9ee1808f27 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:17.000551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2be61fe6-4434-4d73-9d8e-6c928e27f567 req-08cb2f66-9ad0-4f68-bc9f-8c9ee1808f27 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:17.000551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2be61fe6-4434-4d73-9d8e-6c928e27f567 req-08cb2f66-9ad0-4f68-bc9f-8c9ee1808f27 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:17.019681 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-2be61fe6-4434-4d73-9d8e-6c928e27f567 req-08cb2f66-9ad0-4f68-bc9f-8c9ee1808f27 service nova] Creating event network-vif-plugged:b04c5d59-5942-49e6-af63-74888b176926 for instance abceacff-4197-477c-99d2-090dbe5727e4 on hv-cinder-85164 Aug 08 00:35:17.032875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-2be61fe6-4434-4d73-9d8e-6c928e27f567 req-08cb2f66-9ad0-4f68-bc9f-8c9ee1808f27 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063684 Aug 08 00:35:17.035048 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 146/297] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:35:17.273452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:17.275670 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:17.318259 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:17.321218 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:17.323023 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:17.331323 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:17.333091 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:17.333774 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:17.804228 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:17.815607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1da38da5-b3b9-4a2c-933f-91eaff971ba1 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1314 microversion: 2.1 time: 0.546766 Aug 08 00:35:17.831430 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 147/298] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:17 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:17.995200 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-74c3401b-d3ab-408b-903e-4ec62b3e73ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.614036 Aug 08 00:35:17.996428 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 152/299] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Aug 8 00:35:16 2022] POST /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments => generated 188 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:35:18.212234 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:18.213721 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:18.222094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:18.235662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:18.236483 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:18.237527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:18.238201 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:18.238791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:18.308200 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130172) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 00:35:18.669357 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-bb4af61b-1b1b-475c-a9e2-7ee5fa1c74d2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/action" status: 202 len: 0 microversion: 2.20 time: 0.461333 Aug 08 00:35:18.687795 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:18.688714 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:18.697042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 148/300] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 8 00:35:18 2022] POST /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:35:18.707095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:18.711785 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:18.715662 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:18.719624 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:18.719624 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:18.741729 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:18.838661 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:18.839009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:18.847266 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:18.848244 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:18.849220 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:18.850106 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:18.853310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:18.854010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:19.167741 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:19.173705 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:19.179036 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3aacaf20-62ff-4a00-be77-9d74085cb948 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1314 microversion: 2.1 time: 0.345469 Aug 08 00:35:19.179168 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:19.196588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:19.197959 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 149/301] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:18 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:19.198077 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:19.199284 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9b844fd4-1975-489a-91f0-db0c0e3f99f9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1752 microversion: 2.20 time: 0.517450 Aug 08 00:35:19.200240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 153/302] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:18 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1752 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:20.225886 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:20.226494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:20.241936 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:20.243698 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:20.262492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:20.262887 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:20.268304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:20.268875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:20.269646 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:20.270847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:20.272549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:20.274621 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:20.275630 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:20.276910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:20.277422 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:20.283158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:20.470547 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:20.479863 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c593c3d5-e6b2-41eb-9c30-44b34174d4f7 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1464 microversion: 2.1 time: 0.258353 Aug 08 00:35:20.482440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 150/303] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:20 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1464 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:20.553742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:20.564600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:20.564600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:20.564600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:20.564600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:20.565301 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:20.565301 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:20.565301 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:20.607120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Going to try to terminate instance {{(pid=130172) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:35:20.713481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:20.729182 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:20.730703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:20.731898 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-09fe1830-4955-4873-8930-685b12a55f01 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1752 microversion: 2.20 time: 0.503109 Aug 08 00:35:20.737519 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 154/304] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:20 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1752 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:21.186918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6ea43fc5-21d2-462e-8c0f-f2efd2536cf0 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "DELETE /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 204 len: 0 microversion: 2.1 time: 0.638466 Aug 08 00:35:21.189221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 151/305] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:35:20 2022] DELETE /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:35:21.197357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:21.198005 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:21.211738 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:21.212230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:21.212662 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:21.213372 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:21.217208 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:21.221118 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:21.463549 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:21.480315 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4d59313e-a6b4-4c5a-9a49-5b19f0b68475 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1470 microversion: 2.1 time: 0.286863 Aug 08 00:35:21.485018 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 155/306] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:21 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:21.780676 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:21.784523 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:21.796420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:21.797187 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:21.798052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:21.799108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:21.799897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:21.800569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:22.096659 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:22.110942 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:22.112538 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:22.113770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2267fb88-5080-4e8f-b105-f15da8a2d8a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1752 microversion: 2.20 time: 0.349596 Aug 08 00:35:22.114328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 152/307] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:21 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1752 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:22.505497 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:22.506105 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:22.513240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:22.518681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:22.518681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:22.518681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:22.518681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:22.519082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:22.662649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:22.670803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2932755a-ecc0-4404-b489-8b11f2ffa5da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1470 microversion: 2.1 time: 0.169535 Aug 08 00:35:22.671628 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 156/308] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:22 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:23.137797 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:23.138372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:23.145852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:23.146336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:23.179604 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:23.180488 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:23.180974 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:23.188097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:23.539582 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:23.552338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:23.554119 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:23.556288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-040d5c0f-977e-4e06-b94b-b4357c111971 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1754 microversion: 2.20 time: 0.422747 Aug 08 00:35:23.559148 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 153/309] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:23 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1754 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:23.693158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:23.694837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:23.703773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:23.704262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:23.704904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:23.705778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:23.706391 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:23.707037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:23.786169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9ea4581d-378d-440f-87f2-c89fdfe4cf04 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Action: 'create', calling method: .version_select at 0x7fd1a3db4430>, body: {"keypair": {"name": "tempest-TestShelveInstance-594341581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl0WdsohmHFVyMrvno0P1zEq1/VQtDZWwg/iMV0m/ttu2W2fF5f3yn+WC1guV18tI1iz+nPPNA38lREewAh/biws72+W2037ExxX0XF/ZeiuMp3V9rxRVX7aStkTHdL3Q=="}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:23.806458 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-9ea4581d-378d-440f-87f2-c89fdfe4cf04 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Getting quotas for project 3101620baddd42c48179a6f411bbd33e. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:35:23.821979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:23.825973 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-9ea4581d-378d-440f-87f2-c89fdfe4cf04 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Getting quotas for user 0797d03452e9419d93e79ccf1c222391 and project 3101620baddd42c48179a6f411bbd33e. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:35:23.836908 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8b0bfe3a-b821-44cf-a6d3-70b9d45ac1bb tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1428 microversion: 2.1 time: 0.147209 Aug 08 00:35:23.837504 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 154/310] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:23 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1428 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:23.858893 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-49f4b2d6-7308-4519-bb5b-5a87aba21fc6 req-9d89bedf-5731-419f-9934-8c439fe3ebae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abceacff-4197-477c-99d2-090dbe5727e4", "name": "network-vif-deleted", "tag": "b04c5d59-5942-49e6-af63-74888b176926"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:23.882233 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-49f4b2d6-7308-4519-bb5b-5a87aba21fc6 req-9d89bedf-5731-419f-9934-8c439fe3ebae service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:23.882659 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-49f4b2d6-7308-4519-bb5b-5a87aba21fc6 req-9d89bedf-5731-419f-9934-8c439fe3ebae service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:23.883102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-49f4b2d6-7308-4519-bb5b-5a87aba21fc6 req-9d89bedf-5731-419f-9934-8c439fe3ebae service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:23.896803 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-49f4b2d6-7308-4519-bb5b-5a87aba21fc6 req-9d89bedf-5731-419f-9934-8c439fe3ebae service nova] Creating event network-vif-deleted:b04c5d59-5942-49e6-af63-74888b176926 for instance abceacff-4197-477c-99d2-090dbe5727e4 on hv-cinder-85164 Aug 08 00:35:23.901917 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-49f4b2d6-7308-4519-bb5b-5a87aba21fc6 req-9d89bedf-5731-419f-9934-8c439fe3ebae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049399 Aug 08 00:35:23.902706 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 155/311] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:23.977453 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9ea4581d-378d-440f-87f2-c89fdfe4cf04 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.373823 Aug 08 00:35:23.977453 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 157/312] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:35:23 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:24.211925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3c9aea4e-982a-463d-82ba-60bf410387eb tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Action: 'create', calling method: .version_select at 0x7fd1a20f9dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-689850189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkHFtBgmV/D3lsCFc2NYUnrLrxbijmDYEXgVNg9k5AZIJGkn2M0/2m5d0Wv0hN9M8iZgeMd+jxwUEZAl6R1zJPALTzL0eaFjyb95zUbEnR5V9J5skrV+GlsR1cOSEHTzQ=="}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:24.227477 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-3c9aea4e-982a-463d-82ba-60bf410387eb tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Getting quotas for project fc3040045262415cb0fcb9525ba437bc. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:35:24.231512 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-3c9aea4e-982a-463d-82ba-60bf410387eb tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Getting quotas for user 41fecf50555a4effb8aca217296bbad6 and project fc3040045262415cb0fcb9525ba437bc. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:35:24.329282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3c9aea4e-982a-463d-82ba-60bf410387eb tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.122447 Aug 08 00:35:24.329903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 156/313] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:35:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:24.439267 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1641066014", "imageRef": "8934b13b-97a3-472d-ad69-0b2f931a5ded", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-689850189", "networks": [{"uuid": "b7d4df26-7f3c-4a8b-af0d-6e65e40d3930"}]}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:24.499076 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] validate_networks() for [('b7d4df26-7f3c-4a8b-af0d-6e65e40d3930', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:35:24.582996 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:24.583765 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:24.598881 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:24.599849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:24.600472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:24.601627 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:24.602510 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:24.603165 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:24.835681 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:24.847711 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:24.854482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:24.858379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-19ac3463-375f-4a68-adbf-ce98bf4935a0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1754 microversion: 2.20 time: 0.279116 Aug 08 00:35:24.861387 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 157/314] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:24 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1754 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:35:24.883738 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:24.885458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:24.898309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:24.905726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:24.905726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:24.905726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:24.905726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:24.906095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:24.995881 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:24.996552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:24.997058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:24.997584 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lazy-loading 'fault' on Instance uuid abceacff-4197-477c-99d2-090dbe5727e4 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:35:25.050789 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f87028b4b624ebb829a4b61da5f9b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb873acb9dc45d98bb0ccde8ee50a5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:25.055929 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:35:25.056493 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:35:25.057146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:35:25.057754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:35:25.058339 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:35:25.059217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-32230ee4-4633-4ed2-b999-b330d0304304 tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 200 len: 1304 microversion: 2.1 time: 0.196053 Aug 08 00:35:25.061955 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 158/315] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:24 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:25.079599 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:25.079599 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:25.079599 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:25.082261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:25.082742 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:25.083177 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:25.114389 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Getting quotas for project fc3040045262415cb0fcb9525ba437bc. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:35:25.118917 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Getting quotas for user 41fecf50555a4effb8aca217296bbad6 and project fc3040045262415cb0fcb9525ba437bc. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:35:25.131652 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:35:25.133907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8934b13b-97a3-472d-ad69-0b2f931a5ded',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:35:25.262418 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-505b0d26-a15e-4431-88d4-fa3894d8fb0a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827030 Aug 08 00:35:25.263700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 158/316] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:35:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:35:25.274873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1306bb6a-a02a-4f61-a021-b6bbc4bb4157 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:25.275710 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1306bb6a-a02a-4f61-a021-b6bbc4bb4157 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:25.358754 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1306bb6a-a02a-4f61-a021-b6bbc4bb4157 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:25.370782 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1306bb6a-a02a-4f61-a021-b6bbc4bb4157 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1258 microversion: 2.1 time: 0.099887 Aug 08 00:35:25.371736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 159/317] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:25 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1258 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:25.694492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1cd49b6b-22ff-49d6-843a-b67bde30274d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:25.694900 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1cd49b6b-22ff-49d6-843a-b67bde30274d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:25.702763 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1cd49b6b-22ff-49d6-843a-b67bde30274d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:25.703587 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1cd49b6b-22ff-49d6-843a-b67bde30274d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:25.704321 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1cd49b6b-22ff-49d6-843a-b67bde30274d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:25.705229 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1cd49b6b-22ff-49d6-843a-b67bde30274d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:25.705883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1cd49b6b-22ff-49d6-843a-b67bde30274d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:25.706487 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1cd49b6b-22ff-49d6-843a-b67bde30274d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:25.751009 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1cd49b6b-22ff-49d6-843a-b67bde30274d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/ips" status: 200 len: 150 microversion: 2.1 time: 0.060389 Aug 08 00:35:25.751720 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 159/318] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:35:25 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:25.887617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:25.889473 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:25.898309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:25.899112 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:25.899708 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:25.900898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:25.901561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:25.902053 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:26.087793 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:26.088429 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] [instance: abceacff-4197-477c-99d2-090dbe5727e4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:26.095842 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:26.096570 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:26.097198 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:26.097901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:26.098522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:26.098945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:26.115376 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] HTTP exception thrown: Instance abceacff-4197-477c-99d2-090dbe5727e4 could not be found. Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Request method failure captured: Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 HTTP/1.1 Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Foty7D4BamMlV3PVOwez0jTxGe0ui_ZRKkhoKGIYvZipRmqqc58rdAhHLS9JV_OhgQNBZ38XaaR3MFEq-vbTAk-aApkGB_NO7Fb1i8wpxEwsI4apm_TbffGut_uZ7PXPWSQf_i5zvjmFag1JVne386ToBIQBiyiTfm2XJ1VSNrT8k8 Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 0fb873acb9dc45d98bb0ccde8ee50a5a Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-VolumesNegativeTest-1273807410 Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:35:26.117148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0fb873acb9dc45d98bb0ccde8ee50a5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0fb873acb9dc45d98bb0ccde8ee50a5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0fb873acb9dc45d98bb0ccde8ee50a5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0fb873acb9dc45d98bb0ccde8ee50a5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-VolumesNegativeTest-1273807410 Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 0fb873acb9dc45d98bb0ccde8ee50a5a Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-VolumesNegativeTest-1273807410 Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-VolumesNegativeTest-1273807410-project Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 9f87028b4b624ebb829a4b61da5f9b9d Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-VolumesNegativeTest-1273807410-project Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance abceacff-4197-477c-99d2-090dbe5727e4 could not be found. Aug 08 00:35:26.118658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': 'abceacff-4197-477c-99d2-090dbe5727e4'} Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abceacff-4197-477c-99d2-090dbe5727e4 could not be found. Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:35:26.119585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abceacff-4197-477c-99d2-090dbe5727e4 could not be found. Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abceacff-4197-477c-99d2-090dbe5727e4 could not be found. Aug 08 00:35:26.120882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:35:26.132106 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] Returning 404 to user: Instance abceacff-4197-477c-99d2-090dbe5727e4 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:35:26.140556 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f07292cf-245d-4adc-a05a-d060ba7fb0da tempest-VolumesNegativeTest-1273807410 tempest-VolumesNegativeTest-1273807410-project] 10.222.0.15 "GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4" status: 404 len: 111 microversion: 2.1 time: 0.055828 Aug 08 00:35:26.141441 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 160/319] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:26 2022] GET /compute/v2.1/servers/abceacff-4197-477c-99d2-090dbe5727e4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:35:26.162255 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:26.172122 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:26.173622 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:26.183215 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f2de2e08-3b7f-478d-ace1-4a5560e2df03 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.301233 Aug 08 00:35:26.184148 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 160/320] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:25 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:26.392755 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-66ebd5c6-c1d9-4d23-8160-2f614e55503d tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:26.393376 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-66ebd5c6-c1d9-4d23-8160-2f614e55503d tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:26.474581 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-66ebd5c6-c1d9-4d23-8160-2f614e55503d tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:26.487526 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-66ebd5c6-c1d9-4d23-8160-2f614e55503d tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1258 microversion: 2.1 time: 0.094071 Aug 08 00:35:26.487526 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 161/321] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:26 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:27.208644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:27.209489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:27.221030 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:27.221709 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:27.222434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:27.223289 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:27.223907 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:27.224486 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:27.450756 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:27.454929 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:27.471473 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:27.474212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:27.475940 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-009e6e97-769f-4e91-9d28-949387f8bb3c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.271274 Aug 08 00:35:27.478997 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 161/322] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:27 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:27.508513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:27.510835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:27.526546 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:27.534241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:27.534241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:27.534241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:27.534241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:27.535419 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:27.669422 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:27.682075 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b2adaa13-eca8-4863-aeee-2fd2d8aec35a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1254 microversion: 2.1 time: 0.180962 Aug 08 00:35:27.682516 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 162/323] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:27 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1254 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:27.823336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d418ecdc-2ed3-4436-a073-9ca8ace88d22 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "598ed45f-b1a0-496e-bd65-ba5a95643e5e"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:27.832243 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d418ecdc-2ed3-4436-a073-9ca8ace88d22 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:27.845783 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d418ecdc-2ed3-4436-a073-9ca8ace88d22 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:27.846510 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d418ecdc-2ed3-4436-a073-9ca8ace88d22 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:27.847137 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d418ecdc-2ed3-4436-a073-9ca8ace88d22 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:27.848032 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d418ecdc-2ed3-4436-a073-9ca8ace88d22 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:27.849046 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d418ecdc-2ed3-4436-a073-9ca8ace88d22 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:27.849633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d418ecdc-2ed3-4436-a073-9ca8ace88d22 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:28.501702 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:28.502323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:28.515351 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:28.516037 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:28.516336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:28.517114 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:28.517784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:28.518399 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:28.738961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:28.754653 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:28.756876 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:28.758058 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0443318a-5c1a-4f28-aab4-bd4abd02ca92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.261090 Aug 08 00:35:28.758610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 163/324] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:28 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:28.765757 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:28.766508 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:28.775923 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:28.777088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:28.777595 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:28.778942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:28.780703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:28.781566 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:28.914732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:28.925877 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9eae448d-4bc5-4113-8e55-1145473d60d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1254 microversion: 2.1 time: 0.165883 Aug 08 00:35:28.936612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 164/325] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:28 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1254 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:29.143967 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3216f4d4-0afb-47cd-8757-7999eb3f5494 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b8841f7-1374-4bcf-91f8-6fd443037e84"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:29.147192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3216f4d4-0afb-47cd-8757-7999eb3f5494 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:29.163403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3216f4d4-0afb-47cd-8757-7999eb3f5494 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:29.164162 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3216f4d4-0afb-47cd-8757-7999eb3f5494 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:29.164684 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3216f4d4-0afb-47cd-8757-7999eb3f5494 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:29.180531 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3216f4d4-0afb-47cd-8757-7999eb3f5494 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:29.180531 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3216f4d4-0afb-47cd-8757-7999eb3f5494 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:29.180531 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3216f4d4-0afb-47cd-8757-7999eb3f5494 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:35.105068 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:35.365830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:36.479878 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=12 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:37.370732 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d418ecdc-2ed3-4436-a073-9ca8ace88d22 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.551651 Aug 08 00:35:37.377136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3216f4d4-0afb-47cd-8757-7999eb3f5494 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.231906 Aug 08 00:35:37.377136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 165/326] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:35:29 2022] POST /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments => generated 194 bytes in 8234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:35:37.377944 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 162/327] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:35:27 2022] POST /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments => generated 194 bytes in 9560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:37.383036 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:37.388847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:37.410117 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:37.410612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:37.411046 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:37.411786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:37.412236 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:37.412659 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:37.414336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:37.415119 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:37.435038 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:37.448017 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:37.453815 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:37.453815 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:37.453815 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:37.453815 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:37.454287 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:37.570740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:37.580062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1ec0e200-06b0-4908-9eb9-ba9732ca0e38 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1254 microversion: 2.1 time: 0.200646 Aug 08 00:35:37.582676 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 163/328] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:37 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1254 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:37.633926 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:37.644662 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:37.646129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:37.647690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a1b1c17f-c169-45d7-9c69-bef6e61eb6d5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.268462 Aug 08 00:35:37.662114 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 166/329] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:37 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:38.601746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:38.602360 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:38.627633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:38.627633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:38.627633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:38.627633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:38.628004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:38.628004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:38.678412 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:38.679077 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:38.692841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:38.693343 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:38.693868 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:38.694594 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:38.695056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:38.705700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:38.778628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:38.787517 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6ec3e4e7-7290-4b44-8d3f-9c52e3e22c8f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1310 microversion: 2.1 time: 0.189419 Aug 08 00:35:38.791446 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 164/330] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:38 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1310 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:39.046293 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:39.064340 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:39.070338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:39.071640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a4bb6577-c692-42ba-b5ab-76f295d3bce0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.398616 Aug 08 00:35:39.072270 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 167/331] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:38 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:35:39.810233 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:39.810848 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:39.826122 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:39.826605 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:39.827042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:39.828407 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:39.828861 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:39.829446 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:39.923767 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:39.933009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-391c4ca3-1331-43cf-b287-49239600a181 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1316 microversion: 2.1 time: 0.125590 Aug 08 00:35:39.933009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 165/332] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:39 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1316 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:40.098785 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:40.100215 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:40.122971 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:40.123528 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:40.123964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:40.136235 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:40.137496 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:40.141650 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:40.605154 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:40.617199 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:40.632735 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:40.632735 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d149bb08-1271-4966-bfb1-f14b12a6cf9c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.532524 Aug 08 00:35:40.642870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 168/333] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:40 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:40.967677 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:40.968851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:40.992241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:40.992241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:40.993908 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:40.997933 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:41.001032 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:41.001874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:41.240818 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:41.250608 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-56e89910-d8b9-4dcf-9f75-0ebfdeb177c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.297693 Aug 08 00:35:41.256282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 166/334] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:40 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:41.651527 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:41.652983 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:41.668774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:41.669650 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:41.670294 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:41.671265 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:41.672064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:41.672707 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:42.277880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:42.278557 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:42.288181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:42.288972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:42.289462 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:42.290317 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:42.290832 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:42.291291 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:42.591711 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:42.614349 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-43e559ac-75f7-45dd-9f1f-26c1754fe53b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.340525 Aug 08 00:35:42.623349 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 167/335] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:42 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:42.898286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:42.912935 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:42.917388 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:42.922384 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e428917d-a3e0-454b-950a-95f6a9935293 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 1.272429 Aug 08 00:35:42.922384 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 169/336] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:41 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:43.645554 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:43.658793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:43.672307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:43.673214 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:43.676298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:43.676298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:43.676298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:43.677306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:43.920604 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:43.929566 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-338b678c-09f2-4e92-8b9c-364212407bfe tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.291097 Aug 08 00:35:43.931310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 168/337] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:43 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:43.946784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:43.947431 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:43.953023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:43.956398 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-a8595aaf-2f11-43eb-b03e-81695e523f59 req-bd58156d-8aad-44a4-a57e-dcc6f5a0b455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7", "tag": "52a4e9c0-250f-456a-959b-dc428c3b9d82"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:43.962422 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:43.962422 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:43.962422 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:43.976300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:43.977221 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:43.977645 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:43.978285 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-a8595aaf-2f11-43eb-b03e-81695e523f59 req-bd58156d-8aad-44a4-a57e-dcc6f5a0b455 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:43.978778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-a8595aaf-2f11-43eb-b03e-81695e523f59 req-bd58156d-8aad-44a4-a57e-dcc6f5a0b455 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:43.979712 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-a8595aaf-2f11-43eb-b03e-81695e523f59 req-bd58156d-8aad-44a4-a57e-dcc6f5a0b455 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:44.012816 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-a8595aaf-2f11-43eb-b03e-81695e523f59 req-bd58156d-8aad-44a4-a57e-dcc6f5a0b455 service nova] Creating event network-changed:52a4e9c0-250f-456a-959b-dc428c3b9d82 for instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 on hv-cinder-85164 Aug 08 00:35:44.018874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-a8595aaf-2f11-43eb-b03e-81695e523f59 req-bd58156d-8aad-44a4-a57e-dcc6f5a0b455 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066705 Aug 08 00:35:44.020335 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 169/338] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:44.231664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:44.266747 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:44.272242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:44.278888 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-50d8497c-bcee-4a4a-bac5-97ad264be89d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.331186 Aug 08 00:35:44.280734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 170/339] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:43 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:44.955290 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:44.955290 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:44.961514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:44.962046 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:44.962589 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:44.963340 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:44.964086 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:44.964721 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:45.221360 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:45.230761 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a3fbce9c-60cd-4c92-afb9-932d2e07c5b8 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.282108 Aug 08 00:35:45.231930 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 170/340] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:44 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:45.308365 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:45.308964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:45.324740 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:45.325810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:45.328475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:45.329586 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:45.332192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:45.332989 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:45.599477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:45.611799 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:45.619634 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:45.622581 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-390764fc-03a5-43d1-ade5-71e0f3cb4c32 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.318559 Aug 08 00:35:45.623880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 171/341] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:45 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:46.253187 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:46.253979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:46.273114 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:46.273800 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:46.274611 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:46.275946 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:46.276781 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:46.277564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:46.652003 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:46.652616 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:46.675456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:46.675963 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:46.676402 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:46.677122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:46.677564 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:46.680257 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:46.876991 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:46.896075 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-71b82463-0952-405a-958a-ea43de1910f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.647201 Aug 08 00:35:46.902889 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 171/342] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:46 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:47.055970 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:47.063279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:47.071687 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:47.073308 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:47.074523 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-eab74ccd-a5db-4437-ae47-fc575e579676 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.426619 Aug 08 00:35:47.075094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 172/343] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:46 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:47.916319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:47.917138 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:47.927025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:47.931784 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:47.934171 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:47.935129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:47.935767 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:47.938761 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:48.112367 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:48.113053 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:48.133169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:48.140863 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:48.141692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:48.143617 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:48.151827 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:48.151827 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:48.319030 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:48.331725 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-15aec39b-b4a3-4c5b-ac60-9e799effd438 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.416935 Aug 08 00:35:48.332523 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 172/344] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:47 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:48.440781 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:48.455672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:48.457315 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:48.460292 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a4b0b45f-dccb-4a2f-8701-0befbe4e94fd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.361988 Aug 08 00:35:48.464588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 173/345] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:48 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:35:48.658058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-b6b00404-2ccc-4eef-a8f9-12da51de5b2f req-8a35420b-81a7-4323-9c29-09e9c13bf84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4829f58c-adec-413d-83c8-23f1d3143205", "name": "network-vif-plugged", "status": "completed", "tag": "424b2123-2ed7-4eda-bdcf-dd72a3df7bea"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:48.674020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-b6b00404-2ccc-4eef-a8f9-12da51de5b2f req-8a35420b-81a7-4323-9c29-09e9c13bf84d service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:48.678652 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-b6b00404-2ccc-4eef-a8f9-12da51de5b2f req-8a35420b-81a7-4323-9c29-09e9c13bf84d service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:48.685759 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-b6b00404-2ccc-4eef-a8f9-12da51de5b2f req-8a35420b-81a7-4323-9c29-09e9c13bf84d service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:48.711649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-b6b00404-2ccc-4eef-a8f9-12da51de5b2f req-8a35420b-81a7-4323-9c29-09e9c13bf84d service nova] Creating event network-vif-plugged:424b2123-2ed7-4eda-bdcf-dd72a3df7bea for instance 4829f58c-adec-413d-83c8-23f1d3143205 on hv-cinder-85164 Aug 08 00:35:48.728674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-b6b00404-2ccc-4eef-a8f9-12da51de5b2f req-8a35420b-81a7-4323-9c29-09e9c13bf84d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075728 Aug 08 00:35:48.732381 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 173/346] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:49.231124 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-aadf14cd-d79b-4ff9-a34e-1cf731c9c6f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: .version_select at 0x7fd1a20cf1f0>, body: {"keypair": {"name": "tempest-keypair-1188546736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSGR5Qq0lZjISNAQv2sDmL2G2qwjKfvGcxVPi0e9eJS8jb2oH5QdOS0x2Dya6D4061pJPsUp5xmMQNO2KA3Ql+xNeRMiKfj4EezjBq0uGtvhxTKfwu1vLRzEFZ6rYVIqg=="}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:49.252995 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-aadf14cd-d79b-4ff9-a34e-1cf731c9c6f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for project e97eb34021d44eb0a99763034c1e9e87. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:35:49.257398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-aadf14cd-d79b-4ff9-a34e-1cf731c9c6f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for user 7b317f585f8a4da3abe24ab5cf4ee0c0 and project e97eb34021d44eb0a99763034c1e9e87. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:35:49.354832 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:49.360727 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:49.386517 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:49.391161 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:49.392198 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:49.394323 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:49.397650 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:49.400346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:49.406768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-aadf14cd-d79b-4ff9-a34e-1cf731c9c6f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181658 Aug 08 00:35:49.407441 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 174/347] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:35:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:49.496562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:49.497484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:49.504788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:49.505638 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:49.506732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:49.507728 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:49.508503 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:49.509109 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:49.676795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:49.698138 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fb7fc225-e184-429f-9d4f-f2b5892746e7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.347379 Aug 08 00:35:49.700570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 174/348] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:49 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:49.786092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:49.816914 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:49.820317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:49.823700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ae76be22-7286-49b4-8696-124396bbb00c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.337145 Aug 08 00:35:49.828463 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 175/349] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:49 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:50.064851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-554321152", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-594341581", "security_groups": [{"name": "tempest-secgroup-smoke-865781604"}], "networks": [{"uuid": "40eb5d4b-84fa-4b2b-9896-3375999a2051"}], "block_device_mapping_v2": [{"uuid": "204f81ce-5a0c-4534-9537-4673cac7911f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:50.481286 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] validate_networks() for [('40eb5d4b-84fa-4b2b-9896-3375999a2051', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:35:50.525686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1389068786", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "networks": [{"uuid": "bb10d8ed-7241-4962-a6fb-543fbf8ccecf"}]}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:50.673350 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] validate_networks() for [('bb10d8ed-7241-4962-a6fb-543fbf8ccecf', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:35:51.267245 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:35:51.267245 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:35:51.267245 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:35:51.267245 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:35:51.267245 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:35:51.287209 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:51.290766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:51.292144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:51.296009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:51.296009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:51.296009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:51.361610 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Getting quotas for project 3101620baddd42c48179a6f411bbd33e. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:35:51.369903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Getting quotas for user 0797d03452e9419d93e79ccf1c222391 and project 3101620baddd42c48179a6f411bbd33e. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:35:51.466033 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:35:51.466317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:35:51.466749 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:35:51.467245 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:35:51.468534 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:35:51.468682 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='204f81ce-5a0c-4534-9537-4673cac7911f',volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:35:51.469417 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:35:51.495685 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:51.496284 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:51.496819 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:51.500217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:51.501066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:51.502360 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:51.555091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Getting quotas for project b8f2a58683be4aa486cebdf7aa8e0d83. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:35:51.562850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Getting quotas for user f950ecd21b5a4612bff847604ad8efdd and project b8f2a58683be4aa486cebdf7aa8e0d83. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:35:51.581761 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:35:51.584661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:35:51.729805 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-151c1a1e-b78f-42d2-805b-36bef3243875 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209829 Aug 08 00:35:51.738702 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 176/350] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:35:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:35:51.745239 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:51.746317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:51.757295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:51.761416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:51.762200 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:51.763360 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:51.764013 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:51.771999 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:52.039833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6cb59ad5-62c1-48ad-bbf8-3128e008d496 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.981077 Aug 08 00:35:52.042098 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 175/351] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:35:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:35:52.050587 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:52.059619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:52.068013 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:52.070333 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:52.071797 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:52.072716 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:52.078765 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:52.084759 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:52.273833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:52.295373 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4443108a-d024-4aa5-96a2-55b2913943a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.542801 Aug 08 00:35:52.295373 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 177/352] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:51 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:52.312771 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c23441ab-c2e1-4a78-b9d0-d5d74e32f4d2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:52.313660 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c23441ab-c2e1-4a78-b9d0-d5d74e32f4d2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:52.735307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:52.757551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:52.766144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:52.768269 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-bfa9ecd4-1b2f-4cc6-85de-18ea1617c942 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.724956 Aug 08 00:35:52.769341 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c23441ab-c2e1-4a78-b9d0-d5d74e32f4d2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:52.773086 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 176/353] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:52 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:52.777295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c23441ab-c2e1-4a78-b9d0-d5d74e32f4d2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1219 microversion: 2.1 time: 0.487053 Aug 08 00:35:52.784658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 178/354] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:52 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1219 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:52.790360 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f045f29f-8d85-4dbd-b1f4-a4399ce82d68 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:52.790986 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f045f29f-8d85-4dbd-b1f4-a4399ce82d68 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:52.892040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f045f29f-8d85-4dbd-b1f4-a4399ce82d68 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:52.900861 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f045f29f-8d85-4dbd-b1f4-a4399ce82d68 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1087 microversion: 2.1 time: 0.126705 Aug 08 00:35:52.901645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 177/355] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:52 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1087 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:53.307837 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:53.308915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:53.325356 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:53.328446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:53.330275 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:53.331434 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:53.331772 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:53.332209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:53.635567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:53.645412 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-becf0df7-3c48-4a05-8e7c-7b2d45f8d623 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.343904 Aug 08 00:35:53.647990 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 179/356] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:53 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:53.798113 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:53.803267 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:53.806532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:53.807699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:53.807841 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:53.808330 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:53.808953 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:53.809662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:53.810444 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:53.810875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:53.823778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:53.824785 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:53.830369 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:53.830643 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:53.831322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:53.831847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:54.005516 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:54.017784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fd896dce-10cd-49d1-9b6e-9ea0b63a0c98 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1223 microversion: 2.1 time: 0.215583 Aug 08 00:35:54.018862 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 180/357] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:53 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1223 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:54.034024 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:54.034953 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:54.042796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:54.043329 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:54.043768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:54.044512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:54.044973 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:54.045405 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:54.105056 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:54.114295 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:54.118466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:54.123167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ae71ca04-26c7-4563-a9f5-df280873dfcb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.328758 Aug 08 00:35:54.138052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 178/358] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:53 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:54.220802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:54.273439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-25c52324-d219-40de-ab8f-b23bd304cd1a tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1137 microversion: 2.1 time: 0.252949 Aug 08 00:35:54.276346 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 181/359] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:54 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1137 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:54.617295 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1253976842", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5ea35fc-5529-4ec7-b035-b5f2637c5acc"}], "security_groups": [{"name": "tempest-securitygroup--384651240"}], "key_name": "tempest-keypair-1188546736", "user_data": "}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:54.677704 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:54.678312 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:54.696249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:54.696249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:54.696249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:54.696249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:54.696665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:54.697378 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:54.790533 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] validate_networks() for [('a5ea35fc-5529-4ec7-b035-b5f2637c5acc', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:35:54.884494 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:54.893633 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3d274298-a4ad-425e-818e-5ffafd646c88 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.219826 Aug 08 00:35:54.894872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 182/360] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:54 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:55.037833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:55.038444 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:55.046867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.048548 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.048548 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:55.049075 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.049687 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.050114 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:55.131374 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:55.140346 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-324450d9-1365-438a-8043-64ffef8bb20c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1271 microversion: 2.1 time: 0.106155 Aug 08 00:35:55.140929 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 183/361] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:55 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:55.154427 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:55.156222 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:55.166217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.166709 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.167200 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:55.167927 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.168380 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.168957 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:55.440595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:35:55.441864 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:35:55.442647 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:35:55.443871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:35:55.444598 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:35:55.454714 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:55.465358 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:55.467579 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:55.468817 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.469389 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.469954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:55.470628 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-175bfbe1-30b5-473f-b2e6-356e4fdf5c11 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1810 microversion: 2.20 time: 0.320640 Aug 08 00:35:55.470758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.471142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.471594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:55.472168 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 184/362] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:55 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1810 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:55.488763 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:55.489924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:55.500986 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for project e97eb34021d44eb0a99763034c1e9e87. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:35:55.503082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.503673 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.504173 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:55.504950 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.505463 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.505939 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:55.506617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for user 7b317f585f8a4da3abe24ab5cf4ee0c0 and project e97eb34021d44eb0a99763034c1e9e87. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:35:55.528540 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:35:55.532262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:35:55.580803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:55.594398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-65120c24-2bea-4bc2-ac54-44ee913ed48c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1185 microversion: 2.1 time: 0.120967 Aug 08 00:35:55.619714 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 185/363] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:55 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:55.739052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-17ed1946-46fa-4b6c-994e-d8a6e127e9cc tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.127212 Aug 08 00:35:55.747091 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 179/364] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:35:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:35:55.752372 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fd8201a3-70b4-4570-8dd4-4f1f37a64edb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:55.753039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fd8201a3-70b4-4570-8dd4-4f1f37a64edb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:55.881398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fd8201a3-70b4-4570-8dd4-4f1f37a64edb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:55.919086 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:55.919750 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:55.933461 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fd8201a3-70b4-4570-8dd4-4f1f37a64edb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1242 microversion: 2.1 time: 0.183677 Aug 08 00:35:55.952696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 186/365] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:55 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1242 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:55.972648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.973261 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.978844 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:55.978844 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:55.978844 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:55.978844 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:56.169458 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:56.169982 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:56.187782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:56.188384 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:56.188835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:56.189566 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:56.190029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:56.190549 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:56.283384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:56.287674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:56.299825 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-450e9b3b-ebd6-482a-96ce-40e2dffbb6d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.386417 Aug 08 00:35:56.303077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 180/366] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:55 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:56.322833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:56.332769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b0a40929-085f-41f2-9f6f-8da6ac5b3c5a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1277 microversion: 2.1 time: 0.169217 Aug 08 00:35:56.334146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 187/367] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:56 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:56.496705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:56.497284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:56.504965 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:56.509189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:56.509189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:56.509189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:56.509189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:56.509557 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:56.636553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:56.637843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:56.652209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:56.652209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:56.652209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:56.652209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:56.653678 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:56.655215 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:56.817057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:56.817362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:56.826123 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d7d47000-831f-4d83-99af-fa6a67c4e95b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1203 microversion: 2.1 time: 0.197567 Aug 08 00:35:56.829806 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 188/368] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:56 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1203 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:56.839487 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:56.839487 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:56.844931 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-944b44ec-fa1a-4ccf-b6a7-6148958af71d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1797 microversion: 2.20 time: 0.347818 Aug 08 00:35:56.844931 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 181/369] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:35:56 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1797 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:35:56.964733 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c59347af-3763-4a2f-8b6f-f07af2ac78e1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:56.965504 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c59347af-3763-4a2f-8b6f-f07af2ac78e1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:57.056085 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c59347af-3763-4a2f-8b6f-f07af2ac78e1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:57.063621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c59347af-3763-4a2f-8b6f-f07af2ac78e1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1242 microversion: 2.1 time: 0.105711 Aug 08 00:35:57.064195 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 189/370] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:56 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:57.328008 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:57.329529 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:57.357529 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:57.358878 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:57.359586 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:57.360738 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:57.361722 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:57.365349 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:57.367807 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:57.369266 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:57.377971 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:57.378479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:57.378952 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:57.384937 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:57.385524 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:57.394070 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:57.647104 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:57.658342 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-aacf3378-dc7b-4066-a3c2-41c2756c4d36 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.337114 Aug 08 00:35:57.659284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 182/371] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:57 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:57.700841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:57.716602 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-55e42ef4-3704-401e-991e-59d55a6ec1f5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.358402 Aug 08 00:35:57.716602 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 190/372] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:57 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:57.854403 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:57.859395 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:57.869025 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-f89c1eee-1974-466c-b70d-697d440cea83 req-324a10e5-6128-46c3-bd6d-f6732da1904b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7", "name": "network-vif-plugged", "status": "completed", "tag": "52a4e9c0-250f-456a-959b-dc428c3b9d82"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:57.900648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:57.903583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:57.904032 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:57.904760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:57.913911 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:57.914406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:57.923064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-f89c1eee-1974-466c-b70d-697d440cea83 req-324a10e5-6128-46c3-bd6d-f6732da1904b service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:57.927828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-f89c1eee-1974-466c-b70d-697d440cea83 req-324a10e5-6128-46c3-bd6d-f6732da1904b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:57.931001 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-f89c1eee-1974-466c-b70d-697d440cea83 req-324a10e5-6128-46c3-bd6d-f6732da1904b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:57.980854 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-f89c1eee-1974-466c-b70d-697d440cea83 req-324a10e5-6128-46c3-bd6d-f6732da1904b service nova] Creating event network-vif-plugged:52a4e9c0-250f-456a-959b-dc428c3b9d82 for instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 on hv-cinder-85164 Aug 08 00:35:57.998087 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-f89c1eee-1974-466c-b70d-697d440cea83 req-324a10e5-6128-46c3-bd6d-f6732da1904b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132853 Aug 08 00:35:58.000247 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 191/373] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:35:58.085635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:58.086590 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:58.101969 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:58.102135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:58.102578 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:58.103317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:58.110633 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:58.111183 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:58.282471 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:58.292380 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8bdea2d6-7d13-481d-8677-55651e801efd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1270 microversion: 2.1 time: 0.443824 Aug 08 00:35:58.294189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 183/374] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:57 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1270 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:58.318625 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:58.318851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:35:58.324021 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:58.341246 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:58.341945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:58.345156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:58.345156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:58.345156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:58.345443 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9bc42627-cb21-4aac-ae83-8fd8178f960d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1294 microversion: 2.1 time: 0.263640 Aug 08 00:35:58.345757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:58.346138 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 192/375] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:58 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1294 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:35:58.388837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lazy-loading 'flavor' on Instance uuid 8220eb97-0920-4393-9354-094c2f62cc94 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:35:58.679796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:58.680747 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:58.693748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:58.696303 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:58.697008 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:58.697880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:58.700491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:58.701161 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:58.921312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3f213660-bd57-465d-a4aa-94bf7448b0d9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/action" status: 200 len: 32 microversion: 2.1 time: 0.625216 Aug 08 00:35:58.923643 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 184/376] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:35:58 2022] POST /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/action => generated 32 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 00:35:58.930028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:58.931423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:58.941253 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:58.941743 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:58.942189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:58.943057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:58.944584 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:58.945986 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:59.113581 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:59.128317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f96846bd-e72f-4698-9a44-472dbce432ca tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.452368 Aug 08 00:35:59.134782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 193/377] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:58 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:59.145537 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:59.147521 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:59.159145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:59.159915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:59.161432 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:59.171403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:59.171403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:59.171403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:59.369763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:59.378677 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4cbd63c1-b255-4355-a319-7a7f6a65dbf8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.453412 Aug 08 00:35:59.381242 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 185/378] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:58 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:59.389700 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:59.389700 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:59.416878 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:59.423802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:59.423802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:59.423802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:59.423802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:59.424881 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:59.915677 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:59.922911 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=100 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:35:59.931614 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3c80baf7-08dc-4c52-8ea7-316ffa36bec8 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.795555 Aug 08 00:35:59.932366 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 194/379] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:59 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:35:59.940321 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:35:59.941300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:35:59.954412 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:59.956141 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:59.956583 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:59.957457 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:35:59.958021 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:35:59.958553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:35:59.982482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:35:59.991069 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-dc30ba62-92b0-4d2d-ae4e-fbeb1f87959c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.608535 Aug 08 00:35:59.991872 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 186/380] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:59 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:00.009874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-31d83d10-6584-40ac-9908-6f610cf01f83 req-dc9d48f9-bfa3-4d5a-80ef-199566865450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39cb5181-8bc2-4e47-ab31-1f9524d47ef3", "tag": "1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:00.021361 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-31d83d10-6584-40ac-9908-6f610cf01f83 req-dc9d48f9-bfa3-4d5a-80ef-199566865450 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:00.026672 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-31d83d10-6584-40ac-9908-6f610cf01f83 req-dc9d48f9-bfa3-4d5a-80ef-199566865450 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:00.026672 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-31d83d10-6584-40ac-9908-6f610cf01f83 req-dc9d48f9-bfa3-4d5a-80ef-199566865450 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:00.034068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-31d83d10-6584-40ac-9908-6f610cf01f83 req-dc9d48f9-bfa3-4d5a-80ef-199566865450 service nova] Creating event network-changed:1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0 for instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 on hv-cinder-85164 Aug 08 00:36:00.038829 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-31d83d10-6584-40ac-9908-6f610cf01f83 req-dc9d48f9-bfa3-4d5a-80ef-199566865450 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032521 Aug 08 00:36:00.039449 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 187/381] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:00.044333 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-ff12dbc2-5c55-4b8e-a64d-4034410c64f8 req-3bffa57b-f64d-448a-898f-d56cfeb4d934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71", "tag": "db31348c-87d0-4137-be1f-0139a7f53d29"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:00.055521 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-ff12dbc2-5c55-4b8e-a64d-4034410c64f8 req-3bffa57b-f64d-448a-898f-d56cfeb4d934 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:00.056196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-ff12dbc2-5c55-4b8e-a64d-4034410c64f8 req-3bffa57b-f64d-448a-898f-d56cfeb4d934 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:00.056726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-ff12dbc2-5c55-4b8e-a64d-4034410c64f8 req-3bffa57b-f64d-448a-898f-d56cfeb4d934 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:00.059613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:00.080147 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-ff12dbc2-5c55-4b8e-a64d-4034410c64f8 req-3bffa57b-f64d-448a-898f-d56cfeb4d934 service nova] Creating event network-changed:db31348c-87d0-4137-be1f-0139a7f53d29 for instance fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 on hv-cinder-85164 Aug 08 00:36:00.080147 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-ff12dbc2-5c55-4b8e-a64d-4034410c64f8 req-3bffa57b-f64d-448a-898f-d56cfeb4d934 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038628 Aug 08 00:36:00.080800 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 188/382] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:00.088549 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-304db64f-1bcc-4cb2-8b39-4c61390a4a1b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1300 microversion: 2.1 time: 0.154750 Aug 08 00:36:00.101846 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 195/383] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:35:59 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:00.150565 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:00.151385 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:00.160633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:00.161522 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:00.162015 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:00.162730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:00.163184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:00.163632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:00.406777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:00.426284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-eefb105d-b3a4-40d3-94bc-b6143d480368 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1358 microversion: 2.1 time: 0.278464 Aug 08 00:36:00.429768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 189/384] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:00 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:00.448404 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:00.449364 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:00.458464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8332dae7-9e8f-4d33-8280-f25a75d28999 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Action: 'create', calling method: .version_select at 0x7fd1a20d19d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-57551070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWv8RU66EH5zXUpYCFymJD4pJfm+XKESD26U9c9xvjO0E2PrpNRHtcKaMX3olVUprYJM48YMe15aCUTcDGx4y2gIhLZaWZKpVXKFpSyRiXs7fvgwH5V5uvlKSAhV7eBFw=="}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:00.462542 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:00.463047 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:00.463526 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:00.464278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:00.464761 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:00.465187 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:00.494785 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-8332dae7-9e8f-4d33-8280-f25a75d28999 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Getting quotas for project a22da44baa6b472e91d99fbcb03b583c. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:36:00.502444 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-8332dae7-9e8f-4d33-8280-f25a75d28999 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Getting quotas for user 322afd3893ac4c2ba4ab4d449f4d9159 and project a22da44baa6b472e91d99fbcb03b583c. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:36:00.591165 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8332dae7-9e8f-4d33-8280-f25a75d28999 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.374426 Aug 08 00:36:00.591806 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 196/385] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:36:00 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:00.764809 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:00.778175 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-58fd5f00-8204-4946-b402-e8962ba70aaa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.344530 Aug 08 00:36:00.778717 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 190/386] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:00 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:00.955618 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:00.956720 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:00.969469 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:00.971664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:00.972383 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:00.973594 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:00.974871 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:00.975593 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.012447 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:01.013189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:01.023950 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.027925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.028643 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.029601 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.036683 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.037466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.290086 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:01.299113 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ce7fb3c2-ba0c-4294-85fd-7b6ce156c89e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.290406 Aug 08 00:36:01.300058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 191/387] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:01 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:01.305423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:01.306244 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:01.314710 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.315545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.316202 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.317119 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.317793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.319218 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.393565 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:01.403976 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e1315407-3658-4733-861d-ee41ef0bc1c7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.454515 Aug 08 00:36:01.404556 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 197/388] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:00 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:01.407338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:01.415350 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d3d48cf8-02c2-416b-9b2b-a2a5f5e94487 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1300 microversion: 2.1 time: 0.114089 Aug 08 00:36:01.416178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 192/389] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:01 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:01.451120 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:01.452701 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:01.459550 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.460106 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.460472 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.461178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.461655 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.462089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.526697 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:01.802677 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:01.803669 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:01.815839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.815839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.815839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.815839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.816229 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.816229 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.816382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:01.824968 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f18775c4-9182-44c5-96c8-f315a68161c5 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1548 microversion: 2.1 time: 0.377891 Aug 08 00:36:01.839991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 198/390] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:01 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1548 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:01.852156 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:01.852777 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:01.870926 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.871579 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.872060 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:01.872867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:01.873327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:01.874287 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:02.122019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:02.129621 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0ee63137-badd-4a5e-b462-14c9aa65f309 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.330794 Aug 08 00:36:02.134327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 193/391] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:01 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:02.268868 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:02.276879 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-89dd8874-b6f5-4843-b488-b704e3f6f1a6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1548 microversion: 2.1 time: 0.429092 Aug 08 00:36:02.278179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 199/392] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:01 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1548 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:02.297292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:02.302550 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:02.303694 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Searching by: {'deleted': False, 'project_id': 'fc3040045262415cb0fcb9525ba437bc'} {{(pid=130172) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 08 00:36:02.310711 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:02.312191 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:02.312966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:02.313948 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:02.314627 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:02.315116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:02.322324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:02.324272 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:02.325418 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:02.331922 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:02.340180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:02.340985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:02.341956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:02.342629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:02.343459 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:02.487933 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.multi_cell_list [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130172) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 08 00:36:02.745381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:02.749181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b5e99dd1-80b5-41eb-b8a9-aefd254b9b7c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.455563 Aug 08 00:36:02.749924 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 194/393] 10.222.0.15 () {58 vars in 1125 bytes} [Mon Aug 8 00:36:02 2022] GET /compute/v2.1/servers => generated 343 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:02.754892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:02.755779 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:02.762226 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-07b6b561-112f-4767-a6ae-54ec7ac6c3c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.443416 Aug 08 00:36:02.763518 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 200/394] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:02 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:02.771307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:02.772231 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:02.788575 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:02.788575 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:02.788575 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:02.788575 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:02.789558 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:02.789558 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:02.793098 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:02.794038 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:02.794692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:02.795945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:02.796609 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:02.797245 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:02.984751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:02.993690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-584fcde8-992c-4bf6-9de0-da034b4b6650 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1367 microversion: 2.1 time: 0.227854 Aug 08 00:36:02.994522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 201/395] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:02 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:03.003985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:03.004964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:03.012028 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:03.012650 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:03.013179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:03.014703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:03.015413 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:03.015946 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:03.037840 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:03.046789 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9efa5297-7acf-43c7-b124-d8749a2cc5ae tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.295647 Aug 08 00:36:03.049904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 195/396] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:02 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:03.055003 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-2977f97e-e7db-46bd-a8b7-9a080ebe625a req-2d4c0ae0-9396-40f2-afc9-639a8d70dbed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b", "tag": "6d9a7815-8cf6-4ce8-b159-82caa08091e7"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:03.064043 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:03.066112 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2977f97e-e7db-46bd-a8b7-9a080ebe625a req-2d4c0ae0-9396-40f2-afc9-639a8d70dbed service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:03.066599 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2977f97e-e7db-46bd-a8b7-9a080ebe625a req-2d4c0ae0-9396-40f2-afc9-639a8d70dbed service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:03.067055 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2977f97e-e7db-46bd-a8b7-9a080ebe625a req-2d4c0ae0-9396-40f2-afc9-639a8d70dbed service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:03.079279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-2977f97e-e7db-46bd-a8b7-9a080ebe625a req-2d4c0ae0-9396-40f2-afc9-639a8d70dbed service nova] Creating event network-changed:6d9a7815-8cf6-4ce8-b159-82caa08091e7 for instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b on hv-cinder-85164 Aug 08 00:36:03.084892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-2977f97e-e7db-46bd-a8b7-9a080ebe625a req-2d4c0ae0-9396-40f2-afc9-639a8d70dbed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033092 Aug 08 00:36:03.085826 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 196/397] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:03.157644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:03.158377 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:03.166659 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:03.167313 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:03.167858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:03.170695 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:03.170695 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:03.170695 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:03.176411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:03.196902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:03.206204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-75f9609d-4c4f-4394-9a9b-b46f116810a1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1548 microversion: 2.1 time: 0.210440 Aug 08 00:36:03.207120 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 202/398] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:02 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:03.317364 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:03.325665 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b2617a43-69e4-4c83-b106-b4dbe65aae15 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.178768 Aug 08 00:36:03.329388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 197/399] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:03 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:03.784696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:03.785301 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:03.791442 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:03.791929 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:03.792359 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:03.793123 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:03.793568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:03.793992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:04.018841 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:04.019485 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:04.029018 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:04.029794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:04.030575 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:04.031340 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:04.031801 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:04.032411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:04.192220 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:04.200166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-25f6917c-34b3-4c36-a8ee-616207b3ef91 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1367 microversion: 2.1 time: 0.188583 Aug 08 00:36:04.200742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 198/400] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:04 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:04.211306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:04.212147 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:04.219484 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:04.220146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:04.220715 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:04.221546 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:04.222237 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:04.222720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:04.274040 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:04.283462 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-33c33667-d7d5-4afd-ac62-42b5c8327ebf tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.502667 Aug 08 00:36:04.288020 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 203/401] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:03 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:04.349042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:04.349833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:04.356288 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:04.356773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:04.357234 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:04.358804 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:04.359615 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:04.360197 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:04.372073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:04.383081 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fcb002b9-4bec-4179-a5da-44cdb03cdfa5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.175919 Aug 08 00:36:04.384971 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 199/402] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:04 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:04.591681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:04.602690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e34ed377-a033-4f06-8b9c-37a5a94d1d77 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.257592 Aug 08 00:36:04.603532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 204/403] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:04 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:05.221866 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:05.224117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:05.234644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.235618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.236251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.237156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.237811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.238395 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.282295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-76bd2aa8-921e-4f6d-a945-aaa99f0e2344 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8be0a76d-2369-4804-b468-c5a292a781ef"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:05.284788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-76bd2aa8-921e-4f6d-a945-aaa99f0e2344 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:05.291136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76bd2aa8-921e-4f6d-a945-aaa99f0e2344 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.293323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76bd2aa8-921e-4f6d-a945-aaa99f0e2344 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.293323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76bd2aa8-921e-4f6d-a945-aaa99f0e2344 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.293323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76bd2aa8-921e-4f6d-a945-aaa99f0e2344 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.293323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76bd2aa8-921e-4f6d-a945-aaa99f0e2344 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.293688 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-76bd2aa8-921e-4f6d-a945-aaa99f0e2344 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.385704 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:05.394004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-823a139a-734d-4e30-92ff-626461589e48 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1367 microversion: 2.1 time: 0.176974 Aug 08 00:36:05.394569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 200/404] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:05 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:05.398952 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:05.399590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:05.406396 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.406882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.407351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.408046 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.408499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.408925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.514453 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=14 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:05.544223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:05.552731 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-04e6e33a-10fe-4a8f-b4b3-35e2ffea8778 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.156960 Aug 08 00:36:05.553687 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 201/405] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:05 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:05.558429 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:05.559032 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:05.565952 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.566675 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.567118 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.567856 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.568313 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.568739 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.723276 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:05.731648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-dfcaca41-51c8-4f0c-b5a3-06003f170630 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.176713 Aug 08 00:36:05.732215 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 202/406] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:05 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:05.737663 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:05.738208 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:05.744197 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.747945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.747945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.747945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:05.747945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:05.748858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:05.876811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:05.884302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-446f71fb-5a3f-45d4-a1af-f2a176088a4c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.151148 Aug 08 00:36:05.884875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 203/407] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:05 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:06.414705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:06.415367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:06.422572 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:06.423047 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:06.423522 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:06.424205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:06.424657 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:06.425079 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:06.561525 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:06.569143 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-02920298-09a2-49f9-95c4-0aa513695436 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1367 microversion: 2.1 time: 0.158213 Aug 08 00:36:06.569715 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 204/408] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:06 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:06.574122 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:06.574717 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:06.581152 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:06.581795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:06.582829 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:06.583545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:06.584247 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:06.584664 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:06.664514 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-76bd2aa8-921e-4f6d-a945-aaa99f0e2344 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "POST /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.386643 Aug 08 00:36:06.665129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 205/409] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:36:05 2022] POST /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments => generated 194 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:36:06.730965 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:06.739357 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f68a18b6-83c9-4316-8d2b-6b746f742968 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.168586 Aug 08 00:36:06.740028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 205/410] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:06 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:06.755285 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:06.756110 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:06.763218 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:06.763679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:06.764346 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:06.765145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:06.765668 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:06.766095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:06.906123 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:06.906821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:06.908859 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:06.914466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:06.914945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:06.915560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:06.916412 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:06.917034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:06.917641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:06.921227 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d86696ce-7876-4d73-8965-961250afc2e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.170924 Aug 08 00:36:06.921890 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 206/411] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:06 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:07.065453 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:07.072924 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-53914c49-7089-4a4a-aa09-0551a03c3e82 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.171279 Aug 08 00:36:07.073718 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 206/412] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:06 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:07.150243 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-f38043f5-c3d0-48ab-b2a9-86858f9ba1b6 req-232871ef-af25-47e7-b206-aa17c2b8c319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71", "name": "network-vif-plugged", "status": "completed", "tag": "db31348c-87d0-4137-be1f-0139a7f53d29"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:07.160262 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-f38043f5-c3d0-48ab-b2a9-86858f9ba1b6 req-232871ef-af25-47e7-b206-aa17c2b8c319 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:07.160811 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-f38043f5-c3d0-48ab-b2a9-86858f9ba1b6 req-232871ef-af25-47e7-b206-aa17c2b8c319 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:07.161314 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-f38043f5-c3d0-48ab-b2a9-86858f9ba1b6 req-232871ef-af25-47e7-b206-aa17c2b8c319 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:07.173287 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-f38043f5-c3d0-48ab-b2a9-86858f9ba1b6 req-232871ef-af25-47e7-b206-aa17c2b8c319 service nova] Creating event network-vif-plugged:db31348c-87d0-4137-be1f-0139a7f53d29 for instance fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 on hv-cinder-85164 Aug 08 00:36:07.178109 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-f38043f5-c3d0-48ab-b2a9-86858f9ba1b6 req-232871ef-af25-47e7-b206-aa17c2b8c319 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031738 Aug 08 00:36:07.178713 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 207/413] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:07.590958 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:07.591553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:07.598436 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:07.605223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:07.605223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:07.605223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:07.605223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:07.605577 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:07.750529 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:07.758947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-918c2aeb-e5b1-46d9-9dcd-b62eeacc00fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1367 microversion: 2.1 time: 0.171683 Aug 08 00:36:07.759768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 207/414] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:07 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:07.769765 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:07.770676 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:07.781831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:07.782997 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:07.783691 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:07.785890 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:07.786371 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:07.790647 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:07.944113 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:07.944715 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:07.950520 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:07.950999 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:07.951537 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:07.952231 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:07.952678 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:07.953097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:07.974633 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:07.982213 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fed7f294-07b4-40cc-8331-9077d7b9aa3f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.217751 Aug 08 00:36:07.994724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 208/415] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:07 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:08.083242 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:08.091732 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9e3db973-1562-4013-a4d4-06fc5c9d324f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.151360 Aug 08 00:36:08.093078 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 208/416] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:07 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:08.096279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:08.096992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:08.103058 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:08.103611 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:08.104108 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:08.104960 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:08.105411 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:08.105840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:08.237880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:08.245440 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-88824fb1-772f-48ec-84a8-4e35340b4dd6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.155088 Aug 08 00:36:08.246011 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 209/417] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:08 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:08.782025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:08.782832 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:08.789584 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:08.790292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:08.790895 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:08.792016 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:08.792798 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:08.793520 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:08.943537 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:08.950966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3f4d2afc-8ae4-4939-a80e-d74964c9238a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1367 microversion: 2.1 time: 0.173940 Aug 08 00:36:08.952148 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 209/418] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:08 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:09.014801 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:09.015562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:09.021671 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:09.022233 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:09.022752 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:09.023534 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:09.024139 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:09.024557 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:09.114296 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:09.115348 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:09.121470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:09.124137 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:09.124614 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:09.125552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:09.126070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:09.126498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:09.174717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:09.182534 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-dba5cfe7-427c-4df2-b7d6-636d60f2ab9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.172360 Aug 08 00:36:09.183413 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 210/419] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:09 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:09.197352 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-608420c3-d05e-4fe1-beae-71613c615379 req-6f11df4f-7c00-47f3-bc5b-b96d2d145b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b", "name": "network-vif-plugged", "status": "completed", "tag": "6d9a7815-8cf6-4ce8-b159-82caa08091e7"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:09.207408 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-608420c3-d05e-4fe1-beae-71613c615379 req-6f11df4f-7c00-47f3-bc5b-b96d2d145b70 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:09.207980 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-608420c3-d05e-4fe1-beae-71613c615379 req-6f11df4f-7c00-47f3-bc5b-b96d2d145b70 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:09.208537 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-608420c3-d05e-4fe1-beae-71613c615379 req-6f11df4f-7c00-47f3-bc5b-b96d2d145b70 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:09.223818 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-608420c3-d05e-4fe1-beae-71613c615379 req-6f11df4f-7c00-47f3-bc5b-b96d2d145b70 service nova] Creating event network-vif-plugged:6d9a7815-8cf6-4ce8-b159-82caa08091e7 for instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b on hv-cinder-85164 Aug 08 00:36:09.228961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-608420c3-d05e-4fe1-beae-71613c615379 req-6f11df4f-7c00-47f3-bc5b-b96d2d145b70 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035152 Aug 08 00:36:09.229562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 211/420] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:36:09.270329 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:09.271323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:09.281028 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:09.281849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:09.282289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:09.283404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:09.283870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:09.284301 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:09.291278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:09.302445 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-cffb4b29-0fc0-4075-b9bd-714b4f390936 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.190774 Aug 08 00:36:09.302445 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 210/421] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:09 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:09.304241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:09.428980 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:09.437489 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-82b674a5-dd14-42a6-91dd-5caf1610b877 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1319 microversion: 2.1 time: 0.174750 Aug 08 00:36:09.438066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 212/422] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:09 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:09.972536 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:09.973146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:09.979729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:09.980211 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:09.980647 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:09.981348 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:09.981795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:09.982210 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:10.120001 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:10.128301 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ea6a9a34-44f0-4912-a794-3a4335fe90b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1367 microversion: 2.1 time: 0.159369 Aug 08 00:36:10.129275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 211/423] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:09 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:10.204253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:10.205173 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:10.214272 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:10.214767 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:10.216050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:10.216236 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:10.216695 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:10.218140 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:10.321920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:10.322552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:10.329277 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:10.329983 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:10.330645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:10.331372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:10.331827 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:10.332247 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:10.388558 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:10.396368 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a6e74886-9f98-4027-9843-b49692d4321b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.196540 Aug 08 00:36:10.396946 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 213/424] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:10 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:10.462120 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:10.462725 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:10.467814 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:10.469351 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:10.469837 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:10.470268 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:10.470969 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:10.471455 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:10.471881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:10.475848 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a02dbe86-63c2-46fb-b943-1aff1f00948f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.157820 Aug 08 00:36:10.476418 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 212/425] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:10 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:10.510982 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=20 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:10.609187 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:10.616838 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e6c0e26f-952f-48e1-9ca6-22146018a36f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1508 microversion: 2.1 time: 0.158742 Aug 08 00:36:10.617413 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 214/426] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:10 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:11.150104 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:11.150630 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:11.158889 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:11.159635 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:11.160089 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:11.160960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:11.161414 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:11.162000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:11.249491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-03255e00-3785-4d9b-aa59-f70def255994 req-d1f3236f-2408-4baf-aa54-ef9a009f8405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39cb5181-8bc2-4e47-ab31-1f9524d47ef3", "name": "network-vif-plugged", "status": "completed", "tag": "1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:11.256829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-03255e00-3785-4d9b-aa59-f70def255994 req-d1f3236f-2408-4baf-aa54-ef9a009f8405 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:11.257312 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-03255e00-3785-4d9b-aa59-f70def255994 req-d1f3236f-2408-4baf-aa54-ef9a009f8405 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:11.257743 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-03255e00-3785-4d9b-aa59-f70def255994 req-d1f3236f-2408-4baf-aa54-ef9a009f8405 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:11.269376 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-03255e00-3785-4d9b-aa59-f70def255994 req-d1f3236f-2408-4baf-aa54-ef9a009f8405 service nova] Creating event network-vif-plugged:1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0 for instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 on hv-cinder-85164 Aug 08 00:36:11.274321 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-03255e00-3785-4d9b-aa59-f70def255994 req-d1f3236f-2408-4baf-aa54-ef9a009f8405 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032075 Aug 08 00:36:11.274918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 215/427] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:36:11.300031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:11.302967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=100 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:11.311793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8f767c92-cb4a-4b8f-8bac-931b0f0ffe3c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1367 microversion: 2.1 time: 0.164722 Aug 08 00:36:11.314465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 213/428] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:11 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:11.418235 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:11.418849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:11.425847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:11.426327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:11.426762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:11.427507 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:11.427965 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:11.428420 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:11.497803 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:11.499053 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:11.505422 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:11.505918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:11.506987 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:11.507730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:11.508189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:11.508649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:11.578125 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:11.586600 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cb76af7c-2853-42c0-9dce-a2eadbdb36f9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.172624 Aug 08 00:36:11.588020 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 216/429] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:11 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:11.650212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:11.659312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d8f96bb9-eb15-431a-a481-672b8d88a196 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.165786 Aug 08 00:36:11.659882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 214/430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:11 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:12.333116 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:12.333977 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:12.340427 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:12.340899 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:12.341330 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:12.342045 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:12.342493 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:12.342919 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:12.485694 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:12.493467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-04897b9c-69e6-46ee-af97-89cdac73430a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1557 microversion: 2.1 time: 0.164164 Aug 08 00:36:12.494053 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 217/431] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:12 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:12.513976 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c5a74ec0-c2fb-49e6-a297-cd6c6739abec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:12.514527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c5a74ec0-c2fb-49e6-a297-cd6c6739abec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:12.516865 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:12.521646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5a74ec0-c2fb-49e6-a297-cd6c6739abec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:12.522125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5a74ec0-c2fb-49e6-a297-cd6c6739abec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:12.522558 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5a74ec0-c2fb-49e6-a297-cd6c6739abec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:12.523299 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5a74ec0-c2fb-49e6-a297-cd6c6739abec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:12.524542 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5a74ec0-c2fb-49e6-a297-cd6c6739abec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:12.524542 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c5a74ec0-c2fb-49e6-a297-cd6c6739abec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:12.610967 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:12.611863 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:12.612485 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c5a74ec0-c2fb-49e6-a297-cd6c6739abec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102439 Aug 08 00:36:12.613123 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 215/432] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 00:36:12 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:12.632339 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:12.632930 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:12.633612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:12.634395 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:12.635074 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:12.635714 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:12.680769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:12.681377 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:12.688006 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:12.688866 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:12.690705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:12.691725 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:12.695405 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:12.696211 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:12.786651 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:12.794833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c4732c32-1ab2-4b0c-ace1-b46b7b673b86 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.188955 Aug 08 00:36:12.795434 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 218/433] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:12 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:12.930507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:12.938600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-98057e19-fb6e-4675-ad36-4f2716d1dd2b tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.261752 Aug 08 00:36:12.939170 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 216/434] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:12 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:13.815532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:13.816321 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:13.823683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:13.824298 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:13.824674 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:13.825381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:13.825835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:13.826261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:13.962217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:13.963037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:13.971708 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:13.972334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:13.972879 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:13.973855 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:13.974388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:13.974851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:13.976624 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:13.985039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8da8a18e-2c91-4dd4-8818-ca2daf61b9c8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1258 microversion: 2.1 time: 0.173193 Aug 08 00:36:13.987145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 219/435] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:13 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:13.992882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-a404be37-1847-4afa-abd0-08918f268fab req-2ae1733d-84bb-4a81-a011-6342e8806516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b", "tag": "6d9a7815-8cf6-4ce8-b159-82caa08091e7"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:14.004279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-a404be37-1847-4afa-abd0-08918f268fab req-2ae1733d-84bb-4a81-a011-6342e8806516 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:14.004897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-a404be37-1847-4afa-abd0-08918f268fab req-2ae1733d-84bb-4a81-a011-6342e8806516 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:14.005429 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-a404be37-1847-4afa-abd0-08918f268fab req-2ae1733d-84bb-4a81-a011-6342e8806516 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:14.020403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-a404be37-1847-4afa-abd0-08918f268fab req-2ae1733d-84bb-4a81-a011-6342e8806516 service nova] Creating event network-changed:6d9a7815-8cf6-4ce8-b159-82caa08091e7 for instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b on hv-cinder-85164 Aug 08 00:36:14.026069 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-a404be37-1847-4afa-abd0-08918f268fab req-2ae1733d-84bb-4a81-a011-6342e8806516 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037411 Aug 08 00:36:14.027173 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 220/436] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:14.127586 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:14.139639 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b5c0aa35-1231-46d9-bb9c-b489450b58b7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.182309 Aug 08 00:36:14.143336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 217/437] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:13 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:15.006051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:15.006655 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:15.013496 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:15.013979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:15.014415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:15.015849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:15.016301 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:15.016724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:15.159187 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:15.162481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:15.163746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:15.168707 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3f7a1488-69bf-4444-b708-6f4018ec5635 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1441 microversion: 2.1 time: 0.166856 Aug 08 00:36:15.174134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 221/438] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:15 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1441 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:15.176515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:15.177014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:15.177450 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:15.178225 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:15.178798 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:15.179283 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:15.190431 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:15.191042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:15.197503 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:15.197992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:15.198421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:15.199112 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:15.199671 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:15.200088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:15.338398 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:15.345048 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:15.348232 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3583fa2a-9dfc-4be5-a25f-4a196f43d534 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.189576 Aug 08 00:36:15.349402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 218/439] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:15 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:15.356145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8cb0080e-226f-4374-8abc-f21a67d0a150 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1441 microversion: 2.1 time: 0.169444 Aug 08 00:36:15.356727 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 222/440] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:15 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1441 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:16.373625 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:16.374840 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:16.383771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:16.384486 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:16.385308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:16.386019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:16.386660 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:16.387079 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:16.644619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:16.660025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-81123516-50ad-42b0-b5c7-9871c4bfa7d6 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.289869 Aug 08 00:36:16.675737 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 219/441] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:16 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:17.499842 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:17.500453 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:17.507103 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:17.507621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:17.508060 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:17.508910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:17.509382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:17.509809 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:17.662488 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:17.670856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-854f4a04-4828-409b-bd73-46c165d81f73 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1594 microversion: 2.1 time: 0.175364 Aug 08 00:36:17.673086 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-f215e9ac-6b7c-4f70-94b6-11701f67cca4 req-7c9aa853-6f70-41db-95b0-8bb1f835e5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39cb5181-8bc2-4e47-ab31-1f9524d47ef3", "tag": "1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:17.673972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 223/442] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:17 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1594 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:17.687343 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-f215e9ac-6b7c-4f70-94b6-11701f67cca4 req-7c9aa853-6f70-41db-95b0-8bb1f835e5b0 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:17.687343 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-f215e9ac-6b7c-4f70-94b6-11701f67cca4 req-7c9aa853-6f70-41db-95b0-8bb1f835e5b0 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:17.687343 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-f215e9ac-6b7c-4f70-94b6-11701f67cca4 req-7c9aa853-6f70-41db-95b0-8bb1f835e5b0 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:17.695078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:17.696385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:17.708088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:17.708986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:17.709563 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:17.710449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:17.711007 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:17.712197 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:17.717108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-f215e9ac-6b7c-4f70-94b6-11701f67cca4 req-7c9aa853-6f70-41db-95b0-8bb1f835e5b0 service nova] Creating event network-changed:1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0 for instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 on hv-cinder-85164 Aug 08 00:36:17.723341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-f215e9ac-6b7c-4f70-94b6-11701f67cca4 req-7c9aa853-6f70-41db-95b0-8bb1f835e5b0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054783 Aug 08 00:36:17.725332 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 220/443] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:36:18.017257 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:18.029965 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a1fc014e-21d8-4a58-8730-4748ad73e5d0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.339488 Aug 08 00:36:18.031316 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 224/444] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:17 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:19.056750 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:19.059511 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:19.066076 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:19.066564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:19.067000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:19.067731 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:19.068187 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:19.068614 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:19.263822 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:19.271932 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-53a2f39e-27a4-4f45-8159-cb08ddd8e7f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.221631 Aug 08 00:36:19.272508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 221/445] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:19 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:20.192083 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-73bb5ca5-295a-4af8-8ac3-8bb83279dbfa req-30d08099-de34-46e5-9702-2d1043a02207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7", "tag": "52a4e9c0-250f-456a-959b-dc428c3b9d82"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:20.203101 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-73bb5ca5-295a-4af8-8ac3-8bb83279dbfa req-30d08099-de34-46e5-9702-2d1043a02207 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:20.203782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-73bb5ca5-295a-4af8-8ac3-8bb83279dbfa req-30d08099-de34-46e5-9702-2d1043a02207 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:20.204209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-73bb5ca5-295a-4af8-8ac3-8bb83279dbfa req-30d08099-de34-46e5-9702-2d1043a02207 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:20.216510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-73bb5ca5-295a-4af8-8ac3-8bb83279dbfa req-30d08099-de34-46e5-9702-2d1043a02207 service nova] Creating event network-changed:52a4e9c0-250f-456a-959b-dc428c3b9d82 for instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 on hv-cinder-85164 Aug 08 00:36:20.221655 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-73bb5ca5-295a-4af8-8ac3-8bb83279dbfa req-30d08099-de34-46e5-9702-2d1043a02207 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034721 Aug 08 00:36:20.222246 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 225/446] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:20.295537 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:20.297237 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:20.304263 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:20.305030 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:20.305613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:20.306590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:20.307045 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:20.307489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:20.468304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:20.476555 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-65436aa8-69eb-4c9b-86f3-5d4c5a4db4f5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.185411 Aug 08 00:36:20.483245 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 222/447] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:20 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:21.500404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:21.501192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:21.507333 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:21.507752 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:21.508280 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:21.509045 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:21.509500 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:21.509945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:21.645409 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:21.653539 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-30189bcb-8e25-495e-b67a-86e371b01939 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.158187 Aug 08 00:36:21.654110 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 226/448] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:21 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:22.676340 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:22.676952 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:22.683579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:22.684054 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:22.684484 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:22.685176 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:22.685623 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:22.686043 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:22.828941 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:22.837141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-629ae1c4-4180-4eff-8ff4-6ba2d0f1caa1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.164832 Aug 08 00:36:22.837701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 223/449] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:22 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:23.190800 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-900758607"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:23.191363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:23.197929 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:23.198405 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:23.198835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:23.199552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:23.200002 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:23.200416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:23.331864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.network.security_group_api [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Adding security group c227dc7a-bed5-43d0-a843-be28d0e38ab6 to port 52a4e9c0-250f-456a-959b-dc428c3b9d82 Aug 08 00:36:23.764122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f8428cb5-93f3-4984-9836-9408bb3aadcf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "POST /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/action" status: 202 len: 0 microversion: 2.1 time: 0.577962 Aug 08 00:36:23.771342 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 227/450] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:36:23 2022] POST /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:36:23.779432 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:23.780223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-1633ac3e-90b7-4644-a543-2cb7d378d1aa req-16c1723f-938f-4cb1-98d4-3a174be766fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7", "tag": "52a4e9c0-250f-456a-959b-dc428c3b9d82"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:23.787150 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:23.800415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:23.801623 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-1633ac3e-90b7-4644-a543-2cb7d378d1aa req-16c1723f-938f-4cb1-98d4-3a174be766fc service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:23.802600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-1633ac3e-90b7-4644-a543-2cb7d378d1aa req-16c1723f-938f-4cb1-98d4-3a174be766fc service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:23.803712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:23.804360 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-1633ac3e-90b7-4644-a543-2cb7d378d1aa req-16c1723f-938f-4cb1-98d4-3a174be766fc service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:23.805617 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:23.806336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:23.810345 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:23.810787 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:23.824091 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-1633ac3e-90b7-4644-a543-2cb7d378d1aa req-16c1723f-938f-4cb1-98d4-3a174be766fc service nova] Creating event network-changed:52a4e9c0-250f-456a-959b-dc428c3b9d82 for instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 on hv-cinder-85164 Aug 08 00:36:23.831745 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-1633ac3e-90b7-4644-a543-2cb7d378d1aa req-16c1723f-938f-4cb1-98d4-3a174be766fc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061783 Aug 08 00:36:23.833074 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 224/451] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:23.868749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:23.868749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:23.871296 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:23.871797 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:23.872236 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:23.873101 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:23.873601 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:23.874040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:24.018927 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:24.028908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a2ec6e63-a352-41b7-9844-a7f7bb1ab182 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1758 microversion: 2.1 time: 0.253682 Aug 08 00:36:24.029523 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 228/452] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:23 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1758 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:24.044381 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:24.052166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9922f015-6223-4300-8479-afcee3e79cb2 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.193124 Aug 08 00:36:24.052747 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 225/453] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:23 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:25.074454 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:25.075027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:25.081640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:25.082116 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:25.082546 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:25.083275 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:25.084014 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:25.084433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:25.216785 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:25.225723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ca8b03af-b251-47a0-9d57-56d15e25f08f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.155138 Aug 08 00:36:25.226285 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 229/454] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:25 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:26.247897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:26.248477 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:26.255675 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:26.256150 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:26.256579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:26.257257 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:26.257700 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:26.258174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:26.389139 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:26.397352 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8c2f0f98-2dae-43b7-849a-d0e8201e4e00 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.153336 Aug 08 00:36:26.397923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 226/455] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:26 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:27.419013 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:27.419764 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:27.427336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:27.427829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:27.428268 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:27.428979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:27.429436 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:27.429867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:27.564538 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:27.572672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-55c2f1e2-45d5-4a83-9526-0dad83cd37c5 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.157885 Aug 08 00:36:27.573241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 230/456] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:27 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:28.595594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:28.596200 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:28.602332 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:28.602804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:28.603252 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:28.603936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:28.604384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:28.604801 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:28.738272 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:28.746425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3d477a61-f860-42a3-a414-9e7b68ee6600 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.155573 Aug 08 00:36:28.747012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 227/457] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:28 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:29.768354 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:29.768968 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:29.775418 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:29.775894 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:29.776324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:29.777006 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:29.777456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:29.777874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:29.798033 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=100 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:29.912258 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:29.920932 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a3c04ce4-4784-4921-9870-1d451ccf260a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1734 microversion: 2.1 time: 0.156708 Aug 08 00:36:29.921810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 231/458] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:29 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:30.048312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2134109431", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-57551070", "security_groups": [{"name": "tempest-secgroup-smoke-259062108"}], "block_device_mapping_v2": [{"uuid": "f8e2fa4f-7aa0-4810-8e79-ba7c7848328c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e16e278d-24ed-46ec-9b21-78207cc53646"}]}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:30.160093 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] validate_networks() for [('e16e278d-24ed-46ec-9b21-78207cc53646', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:36:30.533186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:36:30.533629 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:36:30.534098 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:36:30.534502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:36:30.534905 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:36:30.544326 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:30.549898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:30.549898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:30.549898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:30.549898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:30.550271 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:30.563916 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Getting quotas for project a22da44baa6b472e91d99fbcb03b583c. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:36:30.567899 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Getting quotas for user 322afd3893ac4c2ba4ab4d449f4d9159 and project a22da44baa6b472e91d99fbcb03b583c. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:36:30.627991 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:36:30.630089 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8e2fa4f-7aa0-4810-8e79-ba7c7848328c',volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:36:30.943911 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:30.944550 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:30.951064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:30.951699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:30.952142 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:30.953006 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:30.953527 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:30.953926 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:31.085624 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:31.094529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3a5b8390-93b8-492a-b92a-b88dff6525e7 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1714 microversion: 2.1 time: 0.154263 Aug 08 00:36:31.095098 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 232/459] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:30 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:31.124367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1c8203c0-47c6-4214-adf2-8f101b0c95d5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.079674 Aug 08 00:36:31.126306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 228/460] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:36:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:36:31.136844 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-82f7322e-4544-4e7f-8a9e-674b81d23508 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:31.137726 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-82f7322e-4544-4e7f-8a9e-674b81d23508 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:31.206942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-82f7322e-4544-4e7f-8a9e-674b81d23508 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:31.215603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-82f7322e-4544-4e7f-8a9e-674b81d23508 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1093 microversion: 2.1 time: 0.083683 Aug 08 00:36:31.216300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 233/461] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:31 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:31.231692 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:31.232367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:31.239665 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:31.240311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:31.240598 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:31.241310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:31.241769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:31.242196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:31.387932 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] HTTP exception thrown: Cannot 'detach_volume' instance 8220eb97-0920-4393-9354-094c2f62cc94 while it is in vm_state rescued Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Request method failure captured: Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments/7b8841f7-1374-4bcf-91f8-6fd443037e84 HTTP/1.1 Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FmiSdbrB2DQZbEo_7DUiSWc_4dae8wGG5xoFF5XZW8ovdJ5Pc-0c4-PyjQUjY4ASLkMp8v9RZbQw52NYnVCxcI5HiJA30AQUXRi0xuHJal7gwJJpJT0uN2V2ZaWbeHIZd479JeoVYQI2OaPhELhP0Lhs3-4ZUcVAzxMiEhitsXyfTo Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:36:31.389478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: c0aa06eea99f4011ab85ec51b0e60f2c Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:36:31.391898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Cannot 'detach_volume' instance 8220eb97-0920-4393-9354-094c2f62cc94 while it is in vm_state rescued Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'server_id': '8220eb97-0920-4393-9354-094c2f62cc94', 'id': '7b8841f7-1374-4bcf-91f8-6fd443037e84'} Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8220eb97-0920-4393-9354-094c2f62cc94 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:36:31.392954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8220eb97-0920-4393-9354-094c2f62cc94 while it is in vm_state rescued Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8220eb97-0920-4393-9354-094c2f62cc94 while it is in vm_state rescued Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:36:31.394811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Returning 409 to user: Cannot 'detach_volume' instance 8220eb97-0920-4393-9354-094c2f62cc94 while it is in vm_state rescued {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:36:31.396407 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b1c1ef1b-7d36-4131-b0fb-054428849750 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments/7b8841f7-1374-4bcf-91f8-6fd443037e84" status: 409 len: 152 microversion: 2.1 time: 0.164380 Aug 08 00:36:31.396407 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 229/462] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:36:31 2022] DELETE /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments/7b8841f7-1374-4bcf-91f8-6fd443037e84 => generated 152 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 08 00:36:31.402567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bb828817-a8d7-4a20-93e0-9526ad9b1a37 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:31.403428 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bb828817-a8d7-4a20-93e0-9526ad9b1a37 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:31.411214 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb828817-a8d7-4a20-93e0-9526ad9b1a37 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:31.411669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb828817-a8d7-4a20-93e0-9526ad9b1a37 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:31.412100 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb828817-a8d7-4a20-93e0-9526ad9b1a37 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:31.412796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb828817-a8d7-4a20-93e0-9526ad9b1a37 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:31.413246 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb828817-a8d7-4a20-93e0-9526ad9b1a37 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:31.413698 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb828817-a8d7-4a20-93e0-9526ad9b1a37 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:31.637668 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bb828817-a8d7-4a20-93e0-9526ad9b1a37 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "POST /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/action" status: 202 len: 0 microversion: 2.1 time: 0.239412 Aug 08 00:36:31.638532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 234/463] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:36:31 2022] POST /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:36:31.658306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:31.659507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:31.679806 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:31.679806 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:31.679806 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:31.679806 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:31.680858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:31.680858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:31.860378 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:31.869021 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b460b9aa-432c-4374-9b3a-4807507c8a4e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1722 microversion: 2.1 time: 0.225561 Aug 08 00:36:31.869811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 230/464] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:31 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:32.241901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a4a4a39e-e4a3-4f08-af7c-0efa80f90e86 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:32.242686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a4a4a39e-e4a3-4f08-af7c-0efa80f90e86 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:32.302171 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a4a4a39e-e4a3-4f08-af7c-0efa80f90e86 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:32.313917 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a4a4a39e-e4a3-4f08-af7c-0efa80f90e86 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1093 microversion: 2.1 time: 0.076426 Aug 08 00:36:32.314931 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 235/465] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:32 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:32.891892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:32.893412 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:32.900036 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:32.900523 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:32.900960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:32.901664 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:32.902117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:32.902543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:33.041466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:33.049643 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5a4240f9-7c47-44c6-9392-089aa1a9951c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1722 microversion: 2.1 time: 0.162749 Aug 08 00:36:33.050211 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 231/466] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:32 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:33.337153 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:33.338104 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:33.340699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=76 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:33.346756 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:33.347261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:33.347698 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:33.348416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:33.348863 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:33.349373 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:33.412643 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:33.420174 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4d1a857d-fe16-4290-8466-a30ae3306fbb tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1135 microversion: 2.1 time: 0.089058 Aug 08 00:36:33.420734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 236/467] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:33 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1135 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:34.071356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:34.071923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:34.074308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:34.078962 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:34.079485 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:34.079918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:34.080607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:34.081057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:34.081481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:34.208026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:34.210810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=100 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:34.217151 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-64abbdae-3403-4e74-8a91-6fabff3dff3e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1722 microversion: 2.1 time: 0.149679 Aug 08 00:36:34.218208 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 232/468] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:34 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:34.441134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:34.441769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:34.448192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:34.448667 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:34.449097 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:34.449774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:34.450221 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:34.450640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:34.511457 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:34.519336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f7b1ce5f-2ed5-400c-b0fe-7ab4f3b13916 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1135 microversion: 2.1 time: 0.082102 Aug 08 00:36:34.519890 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 237/469] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:34 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:35.239710 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:35.240275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:35.247302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:35.250309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:35.250309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:35.250309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:35.250309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:35.250762 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:35.384882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:35.392950 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a54dc6c5-04be-426a-96b1-47fc1e4ce412 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1722 microversion: 2.1 time: 0.157094 Aug 08 00:36:35.393516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 233/470] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:35 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:35.540733 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:35.541262 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:35.548336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:35.548813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:35.549242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:35.549954 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:35.550406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:35.550826 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:35.612972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:35.620273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8e32ba43-fec5-4b97-a467-14d209f44d79 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1191 microversion: 2.1 time: 0.083473 Aug 08 00:36:35.620844 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 238/471] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:35 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:36.413980 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:36.414586 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:36.421580 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:36.422032 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:36.422545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:36.423288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:36.423783 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:36.426716 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:36.561178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:36.569948 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2605dda3-65a3-4b8f-8e65-4121592c3f81 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1728 microversion: 2.1 time: 0.159790 Aug 08 00:36:36.570513 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 234/472] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:36 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:36.591561 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f03777a4-3960-4722-9b65-785636eab5e9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:36.592116 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f03777a4-3960-4722-9b65-785636eab5e9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:36.599021 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f03777a4-3960-4722-9b65-785636eab5e9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:36.599562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f03777a4-3960-4722-9b65-785636eab5e9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:36.599994 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f03777a4-3960-4722-9b65-785636eab5e9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:36.600687 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f03777a4-3960-4722-9b65-785636eab5e9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:36.601128 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f03777a4-3960-4722-9b65-785636eab5e9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:36.601547 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f03777a4-3960-4722-9b65-785636eab5e9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:36.641776 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:36.642388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:36.654284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:36.654785 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:36.655281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:36.656180 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:36.656674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:36.657098 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:36.693602 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f03777a4-3960-4722-9b65-785636eab5e9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105992 Aug 08 00:36:36.694213 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 239/473] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 00:36:36 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:36.776739 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:36.790026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-38689970-338d-4da6-ac27-9d0a7432ed07 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1199 microversion: 2.1 time: 0.152817 Aug 08 00:36:36.802907 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 235/474] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:36 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1199 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:36:36.807713 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7f182728-13d4-4a4b-b7d1-a23081b74bf5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e15c3bad-5ae0-4fff-9115-7f26335a1257", "device": "/dev/sdb"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:36.811420 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-7f182728-13d4-4a4b-b7d1-a23081b74bf5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:36.818679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f182728-13d4-4a4b-b7d1-a23081b74bf5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:36.819259 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f182728-13d4-4a4b-b7d1-a23081b74bf5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:36.819696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f182728-13d4-4a4b-b7d1-a23081b74bf5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:36.821174 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f182728-13d4-4a4b-b7d1-a23081b74bf5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:36.821804 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f182728-13d4-4a4b-b7d1-a23081b74bf5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:36.822245 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f182728-13d4-4a4b-b7d1-a23081b74bf5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:37.749221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-bc24a8ff-d7cb-4a2a-9325-28908874a8ab req-ef966d97-c749-4e6d-b908-0046d54efe6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8220eb97-0920-4393-9354-094c2f62cc94", "tag": "bd00c5d4-343c-4fc4-b81d-fc55458cef59"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:37.762173 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-bc24a8ff-d7cb-4a2a-9325-28908874a8ab req-ef966d97-c749-4e6d-b908-0046d54efe6e service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:37.763147 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-bc24a8ff-d7cb-4a2a-9325-28908874a8ab req-ef966d97-c749-4e6d-b908-0046d54efe6e service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:37.763638 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-bc24a8ff-d7cb-4a2a-9325-28908874a8ab req-ef966d97-c749-4e6d-b908-0046d54efe6e service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:37.779539 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-7f182728-13d4-4a4b-b7d1-a23081b74bf5 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "POST /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.976110 Aug 08 00:36:37.781712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 240/475] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:36:36 2022] POST /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71/os-volume_attachments => generated 194 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:37.782400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-bc24a8ff-d7cb-4a2a-9325-28908874a8ab req-ef966d97-c749-4e6d-b908-0046d54efe6e service nova] Creating event network-changed:bd00c5d4-343c-4fc4-b81d-fc55458cef59 for instance 8220eb97-0920-4393-9354-094c2f62cc94 on hv-cinder-85164 Aug 08 00:36:37.802359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-bc24a8ff-d7cb-4a2a-9325-28908874a8ab req-ef966d97-c749-4e6d-b908-0046d54efe6e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060109 Aug 08 00:36:37.807209 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 236/476] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:37.819865 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:37.820569 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:37.837757 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:37.838177 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:37.838708 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:37.839505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:37.839966 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:37.851346 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:38.178355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:38.186120 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8e790c41-4fc1-4de0-b24b-a58b5bf7e05d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1276 microversion: 2.1 time: 0.370433 Aug 08 00:36:38.200478 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 241/477] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:37 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1276 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:38.667492 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-694ded99-6e92-40c6-bd0c-4681c8ad2502 req-32b3b9da-b49b-4293-aec3-e781e7d43fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4b901e-ba2e-4eaa-bb78-47214419d1a0", "tag": "ef74e25d-7ffe-42e3-9abd-4b9fe8caa2d7"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:38.678442 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-694ded99-6e92-40c6-bd0c-4681c8ad2502 req-32b3b9da-b49b-4293-aec3-e781e7d43fff service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:38.678923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-694ded99-6e92-40c6-bd0c-4681c8ad2502 req-32b3b9da-b49b-4293-aec3-e781e7d43fff service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:38.679438 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-694ded99-6e92-40c6-bd0c-4681c8ad2502 req-32b3b9da-b49b-4293-aec3-e781e7d43fff service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:38.699266 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-694ded99-6e92-40c6-bd0c-4681c8ad2502 req-32b3b9da-b49b-4293-aec3-e781e7d43fff service nova] Creating event network-changed:ef74e25d-7ffe-42e3-9abd-4b9fe8caa2d7 for instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 on hv-cinder-85164 Aug 08 00:36:38.705868 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-694ded99-6e92-40c6-bd0c-4681c8ad2502 req-32b3b9da-b49b-4293-aec3-e781e7d43fff service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042421 Aug 08 00:36:38.707217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 237/478] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:39.207844 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:39.210190 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:39.215365 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:39.215854 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:39.216289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:39.216988 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:39.217441 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:39.218094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:39.426122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:39.433888 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c87df49d-180d-491b-9d77-c09c78a95f94 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.229809 Aug 08 00:36:39.434463 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 242/479] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:39 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:39.817882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-8d385a52-e8d6-436c-b229-edd19f353fb9 req-b51c54ed-3dff-4695-b2ad-1812c763ce01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8220eb97-0920-4393-9354-094c2f62cc94", "tag": "bd00c5d4-343c-4fc4-b81d-fc55458cef59"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:39.828756 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-8d385a52-e8d6-436c-b229-edd19f353fb9 req-b51c54ed-3dff-4695-b2ad-1812c763ce01 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:39.829224 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-8d385a52-e8d6-436c-b229-edd19f353fb9 req-b51c54ed-3dff-4695-b2ad-1812c763ce01 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:39.829648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-8d385a52-e8d6-436c-b229-edd19f353fb9 req-b51c54ed-3dff-4695-b2ad-1812c763ce01 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:39.842736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-8d385a52-e8d6-436c-b229-edd19f353fb9 req-b51c54ed-3dff-4695-b2ad-1812c763ce01 service nova] Creating event network-changed:bd00c5d4-343c-4fc4-b81d-fc55458cef59 for instance 8220eb97-0920-4393-9354-094c2f62cc94 on hv-cinder-85164 Aug 08 00:36:39.848556 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-8d385a52-e8d6-436c-b229-edd19f353fb9 req-b51c54ed-3dff-4695-b2ad-1812c763ce01 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035137 Aug 08 00:36:39.849141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 238/480] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:36:40.455302 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:40.455868 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:40.462686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:40.463171 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:40.463640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:40.464338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:40.464791 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:40.465216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:40.600358 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:40.607928 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-69ef7ebd-6d3b-48c4-8eb1-a4a162c85589 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.156761 Aug 08 00:36:40.609057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 243/481] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:40 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:41.630272 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:41.630963 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:41.632935 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:41.633586 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:41.638896 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:41.640090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:41.652951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:41.652951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:41.652951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:41.652951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:41.783642 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:41.791108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8698aff9-fccf-4dea-898e-bf0d9abee753 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.165047 Aug 08 00:36:41.791697 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 239/482] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:41 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:42.811775 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:42.812296 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:42.814741 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=4 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:42.819675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:42.820162 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:42.820597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:42.821286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:42.821733 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:42.822156 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:42.952963 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:42.960800 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c365bb03-a97e-4c68-b352-0f501e225923 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.153047 Aug 08 00:36:42.961367 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 244/483] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:42 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:43.981287 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:43.981810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:43.988282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:43.988758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:43.989187 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:43.989897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:43.990345 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:43.990761 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:44.119613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:44.127777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-649267a6-5dd1-4f1f-8eac-93ef15a3b4db tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.150339 Aug 08 00:36:44.128357 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 240/484] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:43 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:45.148781 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:45.149373 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:45.156558 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:45.157038 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:45.158006 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:45.158172 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:45.158593 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:45.159018 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:45.298949 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:45.306366 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cb817a0e-a08f-4e2f-95d8-1eb8e421b40f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.161444 Aug 08 00:36:45.306924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 245/485] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:45 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:46.327427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:46.331030 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:46.334408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:46.334883 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:46.335341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:46.336033 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:46.336481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:46.336966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:46.475044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:46.482548 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c34cdec3-6edd-4b09-b3a5-f111fdeaa94b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.159627 Aug 08 00:36:46.483143 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 241/486] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:46 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:47.503689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:47.504289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:47.510595 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:47.511074 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:47.511547 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:47.512232 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:47.512680 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:47.513106 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:47.652061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:47.659546 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1dd0b97f-1326-4aad-a2f8-45c8a20b96b3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.159479 Aug 08 00:36:47.660135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 246/487] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:47 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:48.680860 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:48.681461 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:48.688020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:48.688497 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:48.688926 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:48.689609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:48.690054 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:48.690475 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:48.819418 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:48.827485 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b339432f-8122-4fba-8d38-d4b8e2ac6269 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.149798 Aug 08 00:36:48.834613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 242/488] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:48 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:49.849283 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:49.849888 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:49.856300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:49.856776 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:49.860605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:49.860605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:49.860605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:49.860605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:49.989097 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:49.996784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0bf19160-818a-4c1f-a6a1-927c4982f5ec tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.151231 Aug 08 00:36:49.997355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 247/489] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:49 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:51.017237 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:51.017841 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:51.024219 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:51.024692 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:51.025116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:51.025834 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:51.026579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:51.026694 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:51.158734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:51.166213 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-55e20336-d4a1-4d9c-ad2e-71e54cb26678 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.152942 Aug 08 00:36:51.166776 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 243/490] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:51 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:51.419167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-feb9ffc3-3c84-4777-b84b-e7f9920d7577 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:51.419777 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-feb9ffc3-3c84-4777-b84b-e7f9920d7577 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:51.426654 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-feb9ffc3-3c84-4777-b84b-e7f9920d7577 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:51.427127 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-feb9ffc3-3c84-4777-b84b-e7f9920d7577 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:51.427600 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-feb9ffc3-3c84-4777-b84b-e7f9920d7577 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:51.428287 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-feb9ffc3-3c84-4777-b84b-e7f9920d7577 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:51.428734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-feb9ffc3-3c84-4777-b84b-e7f9920d7577 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:51.429152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-feb9ffc3-3c84-4777-b84b-e7f9920d7577 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:51.432767 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:51.460164 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-feb9ffc3-3c84-4777-b84b-e7f9920d7577 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments/cde507e3-a658-4b99-83f0-19cdbc96dca5" status: 200 len: 194 microversion: 2.20 time: 0.044941 Aug 08 00:36:51.460758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 248/491] 10.222.0.15 () {60 vars in 1454 bytes} [Mon Aug 8 00:36:51 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments/cde507e3-a658-4b99-83f0-19cdbc96dca5 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:36:51.528705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:51.529191 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:51.535732 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:51.536204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:51.536703 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:51.537393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:51.537835 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:51.538333 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:51.624094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lazy-loading 'services' on Instance uuid 4829f58c-adec-413d-83c8-23f1d3143205 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:36:51.655132 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-7c177168-1652-4d30-8c9c-3a4ac616f21f req-0edb4fed-3bb6-40e2-a541-db2249ced65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4b901e-ba2e-4eaa-bb78-47214419d1a0", "name": "network-vif-plugged", "status": "completed", "tag": "ef74e25d-7ffe-42e3-9abd-4b9fe8caa2d7"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:36:51.666248 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-7c177168-1652-4d30-8c9c-3a4ac616f21f req-0edb4fed-3bb6-40e2-a541-db2249ced65a service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:51.666931 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-7c177168-1652-4d30-8c9c-3a4ac616f21f req-0edb4fed-3bb6-40e2-a541-db2249ced65a service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:51.667399 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-7c177168-1652-4d30-8c9c-3a4ac616f21f req-0edb4fed-3bb6-40e2-a541-db2249ced65a service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:51.679424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-7c177168-1652-4d30-8c9c-3a4ac616f21f req-0edb4fed-3bb6-40e2-a541-db2249ced65a service nova] Creating event network-vif-plugged:ef74e25d-7ffe-42e3-9abd-4b9fe8caa2d7 for instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 on hv-cinder-85164 Aug 08 00:36:51.684351 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-7c177168-1652-4d30-8c9c-3a4ac616f21f req-0edb4fed-3bb6-40e2-a541-db2249ced65a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033706 Aug 08 00:36:51.685071 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 249/492] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:36:51.951856 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-daaf495b-7b5f-4f22-9346-94c791e6664c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments/cde507e3-a658-4b99-83f0-19cdbc96dca5" status: 202 len: 0 microversion: 2.20 time: 0.426140 Aug 08 00:36:51.952916 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 244/493] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Aug 8 00:36:51 2022] DELETE /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments/cde507e3-a658-4b99-83f0-19cdbc96dca5 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:36:51.962988 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-67371935-d9a0-4fe9-b2d0-2f41dad3f8e3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:51.966018 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-67371935-d9a0-4fe9-b2d0-2f41dad3f8e3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:51.974402 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67371935-d9a0-4fe9-b2d0-2f41dad3f8e3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:51.974896 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67371935-d9a0-4fe9-b2d0-2f41dad3f8e3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:51.975363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67371935-d9a0-4fe9-b2d0-2f41dad3f8e3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:51.976104 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67371935-d9a0-4fe9-b2d0-2f41dad3f8e3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:51.976562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67371935-d9a0-4fe9-b2d0-2f41dad3f8e3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:51.976986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67371935-d9a0-4fe9-b2d0-2f41dad3f8e3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:52.005395 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-67371935-d9a0-4fe9-b2d0-2f41dad3f8e3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047363 Aug 08 00:36:52.005949 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 250/494] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 00:36:51 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:36:52.189795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:52.190490 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:52.196808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:52.197507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:52.198126 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:52.198836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:52.199318 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:52.199781 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:52.336563 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:52.344093 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b761e5be-78da-4300-8b03-f48c4d14f408 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.159708 Aug 08 00:36:52.344657 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 245/495] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:52 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:53.018592 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1ef5861a-845c-4495-af77-32e5b08cf9dd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:53.020747 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1ef5861a-845c-4495-af77-32e5b08cf9dd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:53.027515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ef5861a-845c-4495-af77-32e5b08cf9dd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:53.028007 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ef5861a-845c-4495-af77-32e5b08cf9dd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:53.028448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ef5861a-845c-4495-af77-32e5b08cf9dd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:53.029145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ef5861a-845c-4495-af77-32e5b08cf9dd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:53.029601 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ef5861a-845c-4495-af77-32e5b08cf9dd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:53.030644 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1ef5861a-845c-4495-af77-32e5b08cf9dd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:53.059558 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1ef5861a-845c-4495-af77-32e5b08cf9dd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045589 Aug 08 00:36:53.060110 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 251/496] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 00:36:53 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:36:53.364663 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:53.365270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:53.371624 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:53.372105 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:53.372554 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:53.373236 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:53.373717 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:53.374226 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:53.503582 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:53.511025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-388b07c7-bf26-4d3f-8bb9-f0b69dae206b tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.150166 Aug 08 00:36:53.511614 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 246/497] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:53 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:54.072414 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5b328943-9783-476f-99fc-63a8f7f77d53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:54.074546 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5b328943-9783-476f-99fc-63a8f7f77d53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:54.081607 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b328943-9783-476f-99fc-63a8f7f77d53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:54.082079 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b328943-9783-476f-99fc-63a8f7f77d53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:54.082512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b328943-9783-476f-99fc-63a8f7f77d53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:54.083194 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b328943-9783-476f-99fc-63a8f7f77d53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:54.083932 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b328943-9783-476f-99fc-63a8f7f77d53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:54.084350 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b328943-9783-476f-99fc-63a8f7f77d53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:54.113590 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5b328943-9783-476f-99fc-63a8f7f77d53 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045346 Aug 08 00:36:54.114145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 252/498] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 00:36:54 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:36:54.532365 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:54.532976 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:54.539377 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:54.539856 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:54.540289 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:54.540981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:54.541430 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:54.541850 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:54.676536 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:54.683935 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9a2a0e44-16cb-4072-ad15-1c029e1738d1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.155887 Aug 08 00:36:54.684498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 247/499] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:54 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:55.125221 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2369fe73-6483-4aed-b953-e9ca10434d20 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:55.127350 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2369fe73-6483-4aed-b953-e9ca10434d20 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:55.133704 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2369fe73-6483-4aed-b953-e9ca10434d20 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:55.134179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2369fe73-6483-4aed-b953-e9ca10434d20 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:55.134612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2369fe73-6483-4aed-b953-e9ca10434d20 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:55.135326 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2369fe73-6483-4aed-b953-e9ca10434d20 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:55.135780 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2369fe73-6483-4aed-b953-e9ca10434d20 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:55.136205 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2369fe73-6483-4aed-b953-e9ca10434d20 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:55.164631 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2369fe73-6483-4aed-b953-e9ca10434d20 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043352 Aug 08 00:36:55.165176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 253/500] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 00:36:55 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:36:55.705783 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:55.706393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:55.713195 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:55.713755 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:55.714125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:55.714816 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:55.715303 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:55.715730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:55.863472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:55.863472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0fde4c95-2457-41a0-8b69-d08561981fab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.157548 Aug 08 00:36:55.863472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 248/501] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:55 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:56.177779 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-15250f63-860b-4c03-8230-0de7319008e9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:56.179969 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-15250f63-860b-4c03-8230-0de7319008e9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:56.186167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-15250f63-860b-4c03-8230-0de7319008e9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:56.186649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-15250f63-860b-4c03-8230-0de7319008e9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:56.187087 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-15250f63-860b-4c03-8230-0de7319008e9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:56.188675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-15250f63-860b-4c03-8230-0de7319008e9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:56.189243 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-15250f63-860b-4c03-8230-0de7319008e9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:56.189672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-15250f63-860b-4c03-8230-0de7319008e9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:56.218320 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-15250f63-860b-4c03-8230-0de7319008e9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044584 Aug 08 00:36:56.218905 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 254/502] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 00:36:56 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:36:56.880070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:56.880805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:56.886753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:56.887384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:56.887830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:56.888535 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:56.889011 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:56.889424 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:57.033755 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:57.041744 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3d5cb7ac-2f7b-46fb-a223-86bac6c196f7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.166600 Aug 08 00:36:57.042336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 249/503] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:56 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:57.230121 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5abc38ef-a60e-49bf-8683-e79ec9e8a4ae tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:57.232180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5abc38ef-a60e-49bf-8683-e79ec9e8a4ae tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:57.239313 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5abc38ef-a60e-49bf-8683-e79ec9e8a4ae tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:57.239803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5abc38ef-a60e-49bf-8683-e79ec9e8a4ae tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:57.240240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5abc38ef-a60e-49bf-8683-e79ec9e8a4ae tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:57.240932 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5abc38ef-a60e-49bf-8683-e79ec9e8a4ae tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:57.241386 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5abc38ef-a60e-49bf-8683-e79ec9e8a4ae tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:57.241812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5abc38ef-a60e-49bf-8683-e79ec9e8a4ae tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:57.269827 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5abc38ef-a60e-49bf-8683-e79ec9e8a4ae tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043745 Aug 08 00:36:57.270379 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 255/504] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 00:36:57 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:57.331619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:57.332121 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:57.338264 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:57.338747 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:57.339189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:57.339902 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:57.340385 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:57.340814 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:57.366677 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Going to try to terminate instance {{(pid=130172) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:36:57.369464 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:36:57.610849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-177ac6b1-e934-4851-a846-ba938dc53535 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 204 len: 0 microversion: 2.20 time: 0.282740 Aug 08 00:36:57.611486 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 250/505] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 8 00:36:57 2022] DELETE /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 00:36:57.619673 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:57.620910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:57.626175 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:57.626657 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:57.627101 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:57.627851 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:57.628306 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:57.628732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:57.759374 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:57.767395 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:57.768949 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:57.770107 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1561ade4-f499-404c-9026-5fa4007562ab tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.154280 Aug 08 00:36:57.770665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 256/506] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:36:57 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:36:58.064018 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:58.064773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:58.071179 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:58.071691 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:58.072129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:58.072817 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:58.073268 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:58.073692 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:58.201307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:58.209335 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e5b8d866-d315-4332-8528-4df4fb04c97f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.149881 Aug 08 00:36:58.209900 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 251/507] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:58 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:58.793239 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:58.793843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:58.800637 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:58.801126 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:58.801546 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:58.802237 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:58.802684 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:58.803102 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:58.932563 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:58.940858 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:58.942372 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:58.943548 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-39e3ce41-a855-445b-92ba-a0cfc61a8bdb tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.154186 Aug 08 00:36:58.944098 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 257/508] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:36:58 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:36:59.230056 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:59.230602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:59.237468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:59.237945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:59.238376 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:59.239056 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:59.239531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:59.239949 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:59.372095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:36:59.389050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-655e053d-d15a-469d-bb73-58718b6902ba tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.162850 Aug 08 00:36:59.389619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 252/509] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:36:59 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:36:59.966854 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:36:59.967475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:36:59.974475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:59.974947 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:59.975482 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:36:59.976168 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:36:59.976620 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:36:59.977039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:00.104499 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:00.112535 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:00.114013 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:00.115155 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-eedc41da-f9db-4eab-b5d3-46446104f2d8 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.152243 Aug 08 00:37:00.115736 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 258/510] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:36:59 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:00.410038 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:00.410634 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:00.417102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:00.417639 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:00.418077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:00.418772 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:00.419217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:00.419662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:00.550632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:00.558190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-85d30fd3-1e3a-45f9-87c8-e11c4f654c5d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.152103 Aug 08 00:37:00.558760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 253/511] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:00 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:01.137730 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:01.138352 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:01.154669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:01.157693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:01.157693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:01.157693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:01.157693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:01.158092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:01.288481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:01.296434 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:01.298659 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:01.299843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-72205c82-9d20-4bf6-bf21-afde5b2b37bd tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.166155 Aug 08 00:37:01.300410 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 259/512] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:01 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:01.579994 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:01.580590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:01.587184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:01.587673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:01.588113 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:01.588800 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:01.589251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:01.589692 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:01.722926 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:01.730476 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-dbb3f66e-70e0-4274-b1bf-db870ad001c3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1264 microversion: 2.1 time: 0.155054 Aug 08 00:37:01.731053 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 254/513] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:01 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:02.322059 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:02.322667 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:02.330272 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:02.330751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:02.331190 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:02.331912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:02.332365 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:02.332789 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:02.472294 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:02.480619 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:02.485176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:02.485176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-62b119c0-0e94-427f-bc51-c8764530a3c9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.165239 Aug 08 00:37:02.485176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 260/514] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:02 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:02.752065 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:02.752672 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:02.759194 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:02.759737 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:02.760170 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:02.760859 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:02.761310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:02.761733 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:02.898634 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:02.906377 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0cc527d1-669a-4571-953f-3c0c71c5c497 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1452 microversion: 2.1 time: 0.158694 Aug 08 00:37:02.907531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 255/515] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:02 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:02.927659 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:02.928201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:02.934182 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:02.934691 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:02.935130 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:02.935850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:02.936304 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:02.936734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:03.065182 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:03.072648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-52985ec4-c949-4bcd-85a3-7a15b98aa506 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1452 microversion: 2.1 time: 0.148986 Aug 08 00:37:03.073219 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 261/516] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:02 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:03.508136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:03.508770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:03.514559 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:03.520791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:03.520791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:03.520791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:03.520791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:03.521158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:03.657629 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:03.666289 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:03.667935 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:03.669218 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e24521f3-405c-4cb5-949b-253e7ac542d4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1725 microversion: 2.20 time: 0.165140 Aug 08 00:37:03.669895 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 256/517] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:03 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:04.620632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:04.621129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:04.623819 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=52 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:04.629073 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:04.629567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:04.630009 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:04.630737 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:04.631198 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:04.631679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:04.693723 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:04.694324 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:04.697054 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:04.702284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:04.702772 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:04.703493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:04.707420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:04.707420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:04.707420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:04.778209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lazy-loading 'services' on Instance uuid fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:04.778852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:04.789689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:04.791484 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:04.792826 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-06f9af26-ba16-40e7-acd7-13883de35eee tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1657 microversion: 2.20 time: 0.103174 Aug 08 00:37:04.794514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 257/518] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:04 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1657 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:37:05.002492 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-a40d1e12-8e57-47d2-a561-acdf8461d509 req-a4c14ae9-1ada-4a5a-b750-6ba556f054b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4829f58c-adec-413d-83c8-23f1d3143205", "name": "network-vif-deleted", "tag": "424b2123-2ed7-4eda-bdcf-dd72a3df7bea"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:05.015023 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-a40d1e12-8e57-47d2-a561-acdf8461d509 req-a4c14ae9-1ada-4a5a-b750-6ba556f054b7 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:05.020222 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-a40d1e12-8e57-47d2-a561-acdf8461d509 req-a4c14ae9-1ada-4a5a-b750-6ba556f054b7 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:05.022016 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-a40d1e12-8e57-47d2-a561-acdf8461d509 req-a4c14ae9-1ada-4a5a-b750-6ba556f054b7 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:05.031108 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-40a6caad-fbe5-4963-b006-224eb6f6dcde tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71/os-volume_attachments/e15c3bad-5ae0-4fff-9115-7f26335a1257" status: 202 len: 0 microversion: 2.1 time: 0.414515 Aug 08 00:37:05.032101 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 262/519] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:37:04 2022] DELETE /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71/os-volume_attachments/e15c3bad-5ae0-4fff-9115-7f26335a1257 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:37:05.046031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-a40d1e12-8e57-47d2-a561-acdf8461d509 req-a4c14ae9-1ada-4a5a-b750-6ba556f054b7 service nova] Creating event network-vif-deleted:424b2123-2ed7-4eda-bdcf-dd72a3df7bea for instance 4829f58c-adec-413d-83c8-23f1d3143205 on hv-cinder-85164 Aug 08 00:37:05.053037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-a40d1e12-8e57-47d2-a561-acdf8461d509 req-a4c14ae9-1ada-4a5a-b750-6ba556f054b7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055206 Aug 08 00:37:05.053651 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 258/520] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:37:05.821645 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:05.822357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:05.831445 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:05.832560 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:05.832997 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:05.833982 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:05.834439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:05.835496 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:05.870292 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:05.870783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:05.871208 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:05.871858 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lazy-loading 'fault' on Instance uuid 4829f58c-adec-413d-83c8-23f1d3143205 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:05.949780 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:05.972424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:05.972424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:05.972424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-af3a7d86-da23-492f-8c0a-056ae806cf19 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 200 len: 1372 microversion: 2.20 time: 0.152709 Aug 08 00:37:05.972850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 263/521] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:05 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:06.996298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:06.997799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:07.006803 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:07.007867 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:07.008403 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:07.009377 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:07.010013 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:07.010585 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:07.026947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] HTTP exception thrown: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Request method failure captured: Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 HTTP/1.1 Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fme81wXHFy-W2EviIkWXgmZjGitmWnSAuSRxPDFDel2xIi_9l1QXSFD0Oo6b86b4mKIr9brfmY5ZZ0aOqdt-XZYJzK5WDIyn2dQBIYYn3cgXJqge9Ov9w_739LQwtLgIQwqwNBwRTsu_ZMPPs-m2Xn3Q4HnzbQwr1OWGELIDZ8w62s Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:37:07.028645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: fcc8eeb749a5457f98492da99199528c Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:37:07.030096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '4829f58c-adec-413d-83c8-23f1d3143205'} Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:37:07.034592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:37:07.036178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:07.037507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Returning 404 to user: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:37:07.037507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4dbdca64-1ab1-4bbc-a630-cc3515abf434 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 404 len: 111 microversion: 2.20 time: 0.039813 Aug 08 00:37:07.037507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 259/522] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:06 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 00:37:07.041586 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-608f8b55-0454-48c4-a222-d5c9b2fab1a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '.version_select at 0x7fd1a2059d30>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:07.070991 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-b4d87b6b-0979-4541-a859-74987e3f2e97 req-b7131e64-379e-418f-913e-2f8e0daa6945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4b901e-ba2e-4eaa-bb78-47214419d1a0", "tag": "ef74e25d-7ffe-42e3-9abd-4b9fe8caa2d7"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:07.081080 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-b4d87b6b-0979-4541-a859-74987e3f2e97 req-b7131e64-379e-418f-913e-2f8e0daa6945 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:07.081553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-b4d87b6b-0979-4541-a859-74987e3f2e97 req-b7131e64-379e-418f-913e-2f8e0daa6945 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:07.081979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-b4d87b6b-0979-4541-a859-74987e3f2e97 req-b7131e64-379e-418f-913e-2f8e0daa6945 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:07.094234 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-b4d87b6b-0979-4541-a859-74987e3f2e97 req-b7131e64-379e-418f-913e-2f8e0daa6945 service nova] Creating event network-changed:ef74e25d-7ffe-42e3-9abd-4b9fe8caa2d7 for instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 on hv-cinder-85164 Aug 08 00:37:07.105284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-b4d87b6b-0979-4541-a859-74987e3f2e97 req-b7131e64-379e-418f-913e-2f8e0daa6945 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031971 Aug 08 00:37:07.105284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 260/523] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:07.125597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-608f8b55-0454-48c4-a222-d5c9b2fab1a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345389577" status: 204 len: 0 microversion: 2.20 time: 0.089688 Aug 08 00:37:07.126785 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 264/524] 10.222.0.15 () {60 vars in 1262 bytes} [Mon Aug 8 00:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345389577 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 08 00:37:07.290908 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:07.291564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:07.298082 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:07.298708 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:07.299308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:07.300238 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:07.300757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:07.301424 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:07.331012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Going to try to terminate instance {{(pid=130172) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:37:07.622109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4b2c09a1-7533-4bf1-bdd4-b2d497e7e486 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 204 len: 0 microversion: 2.1 time: 0.335919 Aug 08 00:37:07.622704 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 261/525] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:37:07 2022] DELETE /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:37:07.632812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:07.633424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:07.639834 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:07.640316 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:07.640747 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:07.641819 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:07.642354 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:07.642778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:07.667304 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:07.784181 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:07.792391 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-51e0db4a-9b1b-4a95-a8aa-95d1b0957dfa tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1514 microversion: 2.1 time: 0.164223 Aug 08 00:37:07.793230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 265/526] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:07 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:08.109228 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-28b377e2-64ba-4044-859a-775037522d90 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'create', calling method: .version_select at 0x7fd1a20c40d0>, body: {"keypair": {"name": "tempest-keypair-955612419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABKb80p4Z/3/eBu9UT8wdwPBENVh7dw70/1+ZQyfs8nxN5uV8jVUxH8g1pY4S7vd33rvHJ/OjwDycxZp8snu6gydWLB28UCT7vFvjKZrx5LuKtVYlywR7qeGmf02gAJww=="}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:08.124605 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-28b377e2-64ba-4044-859a-775037522d90 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Getting quotas for project 1aa84c8a680d49f8be48580c62c18889. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:37:08.128432 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-28b377e2-64ba-4044-859a-775037522d90 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Getting quotas for user fcc8eeb749a5457f98492da99199528c and project 1aa84c8a680d49f8be48580c62c18889. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:37:08.209175 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-28b377e2-64ba-4044-859a-775037522d90 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.103927 Aug 08 00:37:08.209760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 262/527] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Aug 8 00:37:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 08 00:37:08.814433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:08.815037 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:08.821687 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:08.822170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:08.822595 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:08.823498 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:08.824148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:08.824575 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:08.975375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:08.982926 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a2a6017d-aa5a-4f6d-b60c-35b9a08f27c2 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1514 microversion: 2.1 time: 0.172856 Aug 08 00:37:08.983533 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 266/528] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:08 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:10.005207 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:10.005946 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:10.012657 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:10.013513 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:10.013637 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:10.014223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:10.014668 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:10.015087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:10.148798 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:10.156358 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b42b3018-ac68-436e-a91b-94be10063bfb tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1514 microversion: 2.1 time: 0.156216 Aug 08 00:37:10.157078 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 263/529] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:09 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:10.628661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-1f68908d-a82a-4518-893d-29c89c1ab30c req-33ee7666-b5ca-4cfc-b16b-8cbaf566f024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71", "name": "network-vif-deleted", "tag": "db31348c-87d0-4137-be1f-0139a7f53d29"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:10.638389 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-1f68908d-a82a-4518-893d-29c89c1ab30c req-33ee7666-b5ca-4cfc-b16b-8cbaf566f024 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:10.638864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-1f68908d-a82a-4518-893d-29c89c1ab30c req-33ee7666-b5ca-4cfc-b16b-8cbaf566f024 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:10.639315 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-1f68908d-a82a-4518-893d-29c89c1ab30c req-33ee7666-b5ca-4cfc-b16b-8cbaf566f024 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:10.653846 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-1f68908d-a82a-4518-893d-29c89c1ab30c req-33ee7666-b5ca-4cfc-b16b-8cbaf566f024 service nova] Creating event network-vif-deleted:db31348c-87d0-4137-be1f-0139a7f53d29 for instance fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 on hv-cinder-85164 Aug 08 00:37:10.658840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-1f68908d-a82a-4518-893d-29c89c1ab30c req-33ee7666-b5ca-4cfc-b16b-8cbaf566f024 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034413 Aug 08 00:37:10.659711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 267/530] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:10.821018 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1180464583", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80d6d476-8f39-44d3-b747-4eed8b7c1a18"}], "security_groups": [{"name": "tempest-securitygroup--109309726"}], "key_name": "tempest-keypair-955612419", "user_data": "}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:10.926101 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] validate_networks() for [('80d6d476-8f39-44d3-b747-4eed8b7c1a18', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:37:11.178500 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:11.179597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:11.186177 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:11.186755 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:11.187281 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:11.188055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:11.188723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:11.189811 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:11.222231 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:11.222716 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:11.223151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:11.223623 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lazy-loading 'fault' on Instance uuid fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:11.266858 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:11.274479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-232789fa-b7fb-4c4a-af31-c4f78ea9097f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 200 len: 1309 microversion: 2.1 time: 0.100151 Aug 08 00:37:11.275330 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 268/531] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:11 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:11.553793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:37:11.554323 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:37:11.554736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:37:11.555175 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:37:11.555614 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:37:11.564659 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:11.570686 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:11.570686 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:11.570686 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:11.570686 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:11.571096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:11.583968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Getting quotas for project 1aa84c8a680d49f8be48580c62c18889. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:37:11.587943 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Getting quotas for user fcc8eeb749a5457f98492da99199528c and project 1aa84c8a680d49f8be48580c62c18889. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:37:11.600343 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:37:11.603239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:37:11.721869 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-54c6fc28-8a0c-4239-97e4-b51ddb07d33f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.905034 Aug 08 00:37:11.722430 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 264/532] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Aug 8 00:37:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 08 00:37:11.733418 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e75cc7a9-d8ef-4afa-b360-59f9cf5a6a30 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:11.734657 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e75cc7a9-d8ef-4afa-b360-59f9cf5a6a30 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:11.790025 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e75cc7a9-d8ef-4afa-b360-59f9cf5a6a30 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:11.797695 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e75cc7a9-d8ef-4afa-b360-59f9cf5a6a30 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:11.799788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e75cc7a9-d8ef-4afa-b360-59f9cf5a6a30 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:11.800912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e75cc7a9-d8ef-4afa-b360-59f9cf5a6a30 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1281 microversion: 2.20 time: 0.071440 Aug 08 00:37:11.801468 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 269/533] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:11 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:37:12.295430 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:12.296080 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:12.302117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:12.302596 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:12.303092 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:12.303799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:12.310516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:12.310516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:12.318389 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] HTTP exception thrown: Instance fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 could not be found. Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Request method failure captured: Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 HTTP/1.1 Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FpjiylEYFDzJSNBmH3YGkhqIiF-cpxGN7QLu5wo-dBZeHHF3Yhgl5Eu6pARIWt3cRpcKIfnr561rvzOHUoDK254pJ4_KFmKXxzNoQMwjpGgVoQ5ZSTWQvqSOEhyTTkxeNYNBR5YGSRZ3aOOHzzxVZD0oZBID72U6BIn79fu-gFL4Ew Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: b8f2a58683be4aa486cebdf7aa8e0d83 Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1144645517 Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:37:12.320040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8f2a58683be4aa486cebdf7aa8e0d83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f2a58683be4aa486cebdf7aa8e0d83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f2a58683be4aa486cebdf7aa8e0d83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8f2a58683be4aa486cebdf7aa8e0d83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesSnapshotTestJSON-1144645517 Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: b8f2a58683be4aa486cebdf7aa8e0d83 Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1144645517 Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesSnapshotTestJSON-1144645517-project Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: f950ecd21b5a4612bff847604ad8efdd Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesSnapshotTestJSON-1144645517-project Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 could not be found. Aug 08 00:37:12.321469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71'} Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 could not be found. Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:37:12.322302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 could not be found. Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 could not be found. Aug 08 00:37:12.323871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:12.325240 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Returning 404 to user: Instance fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:37:12.325240 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-62825dc7-deea-47bd-bf41-20e25fb6519a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71" status: 404 len: 111 microversion: 2.1 time: 0.030432 Aug 08 00:37:12.325240 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 265/534] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:12 2022] GET /compute/v2.1/servers/fb8a0c4d-9a66-46c5-8ae2-a4bc75549c71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:37:12.823439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:12.824021 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:12.831697 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:12.832189 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:12.832636 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:12.833352 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:12.834046 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:12.834532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:12.896979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:12.905043 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:12.906645 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:12.908115 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ace09ce7-c736-42f0-b7e9-ce9b5cff7172 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1285 microversion: 2.20 time: 0.089066 Aug 08 00:37:12.908739 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 270/535] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:12 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:37:13.806645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-faa6c90e-589f-491e-8cc6-6d3a8b5d7515 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:13.809079 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-faa6c90e-589f-491e-8cc6-6d3a8b5d7515 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:13.816034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-faa6c90e-589f-491e-8cc6-6d3a8b5d7515 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:13.816511 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-faa6c90e-589f-491e-8cc6-6d3a8b5d7515 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:13.816943 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-faa6c90e-589f-491e-8cc6-6d3a8b5d7515 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:13.817628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-faa6c90e-589f-491e-8cc6-6d3a8b5d7515 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:13.818075 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-faa6c90e-589f-491e-8cc6-6d3a8b5d7515 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:13.818496 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-faa6c90e-589f-491e-8cc6-6d3a8b5d7515 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:13.930776 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:13.931353 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:13.937850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:13.938324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:13.938754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:13.940009 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:13.940467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:13.940887 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:14.000851 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:14.009258 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:14.010738 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:14.011861 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a717dd0e-4d8e-432d-8042-07eb1614ba25 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1333 microversion: 2.20 time: 0.085023 Aug 08 00:37:14.012417 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 271/536] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:13 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:37:14.013925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-faa6c90e-589f-491e-8cc6-6d3a8b5d7515 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "POST /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/action" status: 202 len: 0 microversion: 2.1 time: 0.210955 Aug 08 00:37:14.014648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 266/537] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:37:13 2022] POST /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:37:14.022721 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:14.023532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:14.029431 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:14.029919 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:14.030421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:14.031088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:14.031578 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:14.032003 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:14.173252 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:14.181938 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b86c0433-dc3c-42a2-b751-f81b9eef91ad tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1750 microversion: 2.1 time: 0.162653 Aug 08 00:37:14.182454 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 272/538] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:14 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:15.038007 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:15.038632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:15.044821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:15.045296 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:15.045728 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:15.046410 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:15.046860 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:15.047377 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:15.061887 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:15.109900 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:15.118328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:15.119858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:15.120948 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-76b87ed4-f0d0-4627-834c-69c6459fcfc9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1333 microversion: 2.20 time: 0.088375 Aug 08 00:37:15.121498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 267/539] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:15 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:15.204501 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:15.205681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:15.212457 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:15.212941 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:15.213379 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:15.214073 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:15.214519 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:15.214948 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:15.354022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:15.364385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6749a910-2b8c-4ed5-b555-4c5d5e1bdaa6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1750 microversion: 2.1 time: 0.163698 Aug 08 00:37:15.365081 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 273/540] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:15 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:16.144173 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:16.144856 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:16.151773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:16.157050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:16.157050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:16.157050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:16.157050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:16.157409 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:16.221446 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:16.229547 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:16.231039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:16.232233 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9a1f630e-e34e-4af2-bf84-20159b033176 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1333 microversion: 2.20 time: 0.092779 Aug 08 00:37:16.232792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 268/541] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:16 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:16.385742 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:16.386404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:16.392990 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:16.393476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:16.393917 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:16.394693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:16.395094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:16.395543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:16.619019 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:16.628543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-27b33bcc-8de2-47ab-9f15-8b2eff1993d1 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1750 microversion: 2.1 time: 0.246143 Aug 08 00:37:16.643310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 274/542] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:16 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1750 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:17.253959 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:17.254556 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:17.260940 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:17.261412 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:17.261844 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:17.262525 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:17.262977 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:17.263414 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:17.496282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:17.506327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:17.507941 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:17.509073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8dfd64d1-1616-4b7e-ba6a-468e7c29884e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.258988 Aug 08 00:37:17.509837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 269/543] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:17 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:17.650477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:17.651753 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:17.657840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:17.658958 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:17.659358 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:17.660061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:17.660510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:17.660976 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:17.805377 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:17.813556 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1e4c4339-0100-4cf8-9a48-aa1491e575b7 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.167488 Aug 08 00:37:17.814201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 275/544] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:17 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:18.326605 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-053f4234-bbbc-4259-b5e8-083154e4db1c req-bf718503-2942-4dd3-bb70-85b0dfdefb9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf02d3a-b426-4135-a94a-9048d7515184", "tag": "434deac6-5c7d-4020-9d69-11e8d0ac4767"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:18.337446 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-053f4234-bbbc-4259-b5e8-083154e4db1c req-bf718503-2942-4dd3-bb70-85b0dfdefb9e service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:18.337918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-053f4234-bbbc-4259-b5e8-083154e4db1c req-bf718503-2942-4dd3-bb70-85b0dfdefb9e service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:18.338343 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-053f4234-bbbc-4259-b5e8-083154e4db1c req-bf718503-2942-4dd3-bb70-85b0dfdefb9e service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:18.349203 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-053f4234-bbbc-4259-b5e8-083154e4db1c req-bf718503-2942-4dd3-bb70-85b0dfdefb9e service nova] Creating event network-changed:434deac6-5c7d-4020-9d69-11e8d0ac4767 for instance 0cf02d3a-b426-4135-a94a-9048d7515184 on hv-cinder-85164 Aug 08 00:37:18.353841 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-053f4234-bbbc-4259-b5e8-083154e4db1c req-bf718503-2942-4dd3-bb70-85b0dfdefb9e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030846 Aug 08 00:37:18.359005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 270/545] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:18.533552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:18.534287 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:18.540730 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:18.541216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:18.541653 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:18.542580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:18.542901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:18.543604 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:18.764087 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:18.772525 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:18.777981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:18.777981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8bbb81a1-d491-42b2-8301-b2e19cd37189 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.245520 Aug 08 00:37:18.777981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 276/546] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:18 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:18.836309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:18.837006 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:18.843535 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:18.844026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:18.844459 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:18.845168 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:18.845718 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:18.846143 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:19.078420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:19.087315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2ce9b873-dc8b-4189-b90e-d1968229f170 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.255634 Aug 08 00:37:19.087952 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 271/547] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:18 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:19.797616 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:19.798223 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:19.804716 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:19.805194 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:19.805629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:19.806322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:19.806770 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:19.807193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:19.935979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:19.944802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:19.946305 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:19.947447 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-46afac71-475d-4588-8572-28cf90be42d1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.153841 Aug 08 00:37:19.948011 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 277/548] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:19 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:20.108753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:20.109388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:20.116437 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:20.116905 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:20.117335 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:20.118014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:20.118459 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:20.118877 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:20.260072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:20.268002 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f4a1cb68-7b51-4bf9-b28b-f81a157cb4f6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.163107 Aug 08 00:37:20.268569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 272/549] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:20 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:20.970290 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:20.971422 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:20.977910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:20.978381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:20.978812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:20.979525 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:20.979973 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:20.980392 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:21.109297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:21.117116 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:21.118613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:21.119733 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cd353cbe-b7df-4d9f-9040-c99a3f82548d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.153397 Aug 08 00:37:21.120270 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 278/550] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:20 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:21.288821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:21.289344 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:21.295855 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:21.296335 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:21.296769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:21.297457 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:21.297904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:21.298327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:21.441264 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:21.449281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-52b540cf-82cf-4217-9a09-91804f7da3c4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.164467 Aug 08 00:37:21.449856 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 273/551] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:21 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:22.141447 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:22.142064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:22.144143 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:22.149561 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:22.150039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:22.150475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:22.151188 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:22.151672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:22.152108 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:22.282847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:22.291454 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:22.292997 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:22.294083 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3bfecb9d-6eeb-4cb8-a9d3-ddc3bf197018 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.156572 Aug 08 00:37:22.294633 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 279/552] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:22 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:22.471794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:22.472480 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:22.475254 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:22.475965 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=10 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:22.481291 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:22.481765 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:22.482200 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:22.482890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:22.483413 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:22.483838 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:22.676288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:22.684308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-18c1f99b-32aa-4d5c-b91c-9e9129820ff2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.216663 Aug 08 00:37:22.684885 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 274/553] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:22 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:22.806147 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2067896317", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "networks": [{"uuid": "bb10d8ed-7241-4962-a6fb-543fbf8ccecf"}]}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:22.860897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] validate_networks() for [('bb10d8ed-7241-4962-a6fb-543fbf8ccecf', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:37:23.200840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:37:23.201418 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:37:23.201754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:37:23.202163 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:37:23.202571 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:37:23.211775 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:23.212256 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:23.212692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:23.213430 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:23.213868 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:23.214295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:23.230541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Getting quotas for project b8f2a58683be4aa486cebdf7aa8e0d83. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:37:23.234459 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Getting quotas for user f950ecd21b5a4612bff847604ad8efdd and project b8f2a58683be4aa486cebdf7aa8e0d83. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:37:23.245699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:37:23.247967 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:37:23.318178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:23.318741 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:23.324655 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:23.325127 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:23.325558 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:23.326238 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:23.326685 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:23.327100 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:23.373344 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-250250d3-7039-4763-b879-91343ac1d308 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570962 Aug 08 00:37:23.374125 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 280/554] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:37:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:37:23.388388 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-38ed243f-1b1d-44bb-b849-33cdec2910ef tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:23.390202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-38ed243f-1b1d-44bb-b849-33cdec2910ef tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:23.457918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-38ed243f-1b1d-44bb-b849-33cdec2910ef tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:23.466525 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-38ed243f-1b1d-44bb-b849-33cdec2910ef tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1219 microversion: 2.1 time: 0.085019 Aug 08 00:37:23.467273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 281/555] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:23 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:23.481531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:23.490627 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:23.492180 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:23.493287 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-94945322-8ef6-44b6-ad18-d1149b1f9275 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.180105 Aug 08 00:37:23.493837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 275/556] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:23 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:37:23.766584 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:23.772179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:23.773694 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:23.774181 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:23.774613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:23.775336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:23.775791 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:23.776216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:23.925128 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:23.935216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d623a825-62cc-4796-b61e-7e3188986bd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.172497 Aug 08 00:37:23.936667 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 282/557] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:23 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:24.487138 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:24.487755 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:24.494773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.495274 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.495712 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.496436 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.496885 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.497307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.515498 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:24.516305 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:24.523316 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.523818 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.524227 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.524914 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.525362 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.525783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.568622 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:24.577676 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-78479a3b-b612-4a72-9ca1-ec6bdc087647 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1223 microversion: 2.1 time: 0.094158 Aug 08 00:37:24.578440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 276/558] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:24 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:24.584439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e55e8ad2-7b22-43c7-b118-2a45fba1160d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:24.585014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e55e8ad2-7b22-43c7-b118-2a45fba1160d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:24.591037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e55e8ad2-7b22-43c7-b118-2a45fba1160d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.591626 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e55e8ad2-7b22-43c7-b118-2a45fba1160d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.592141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e55e8ad2-7b22-43c7-b118-2a45fba1160d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.595423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e55e8ad2-7b22-43c7-b118-2a45fba1160d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.595423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e55e8ad2-7b22-43c7-b118-2a45fba1160d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.595423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e55e8ad2-7b22-43c7-b118-2a45fba1160d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.622281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e55e8ad2-7b22-43c7-b118-2a45fba1160d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b/ips" status: 200 len: 150 microversion: 2.1 time: 0.042530 Aug 08 00:37:24.623106 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 277/559] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:37:24 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:24.636453 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "598ed45f-b1a0-496e-bd65-ba5a95643e5e"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:24.639203 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:24.646157 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.646836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.647369 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.648143 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.648669 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.649441 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.695908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:24.704962 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:24.706629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:24.708920 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-45609f15-6665-4c49-8457-407b9e13bda9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.197053 Aug 08 00:37:24.710417 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 283/560] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:24 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:37:24.739024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Invalid volume: volume 598ed45f-b1a0-496e-bd65-ba5a95643e5e is already attached to instances: 728de657-b1e9-4f61-8dcf-d5cc9553eb16 Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: POST /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b/os-volume_attachments HTTP/1.1 Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 74 Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:37:24.740771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {"volumeAttachment": {"volumeId": "598ed45f-b1a0-496e-bd65-ba5a95643e5e"}} Aug 08 00:37:24.742351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Invalid volume: volume 598ed45f-b1a0-496e-bd65-ba5a95643e5e is already attached to instances: 728de657-b1e9-4f61-8dcf-d5cc9553eb16 Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'server_id': '0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b', 'body': {'volumeAttachment': {'volumeId': '598ed45f-b1a0-496e-bd65-ba5a95643e5e'}}} Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 598ed45f-b1a0-496e-bd65-ba5a95643e5e is already attached to instances: 728de657-b1e9-4f61-8dcf-d5cc9553eb16 Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:24.743282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 598ed45f-b1a0-496e-bd65-ba5a95643e5e is already attached to instances: 728de657-b1e9-4f61-8dcf-d5cc9553eb16 Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:24.744778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:24.746331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:24.746331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:37:24.746331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:37:24.746331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 598ed45f-b1a0-496e-bd65-ba5a95643e5e is already attached to instances: 728de657-b1e9-4f61-8dcf-d5cc9553eb16 Aug 08 00:37:24.746331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:24.746331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 400 to user: Invalid volume: volume 598ed45f-b1a0-496e-bd65-ba5a95643e5e is already attached to instances: 728de657-b1e9-4f61-8dcf-d5cc9553eb16 {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:37:24.746331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1a474b53-217a-4cff-8d3a-ae185beeea6c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110156 Aug 08 00:37:24.746331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 278/561] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:37:24 2022] POST /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 00:37:24.750938 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:24.751536 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:24.757641 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.758132 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.758565 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.759273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.759728 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.760150 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.785997 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:37:24.799603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=100 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:24.956570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:24.957879 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:24.964852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.965327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.965752 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:24.966439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:24.967705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:24.968136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:25.038711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-38ca9e12-9bae-40a2-9bc3-384ddc62f074 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 204 len: 0 microversion: 2.1 time: 0.291182 Aug 08 00:37:25.039238 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 284/562] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:37:24 2022] DELETE /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:37:25.047752 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:25.056170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:25.056170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:25.056170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:25.056170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:25.056678 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:25.056927 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:25.057359 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:25.110543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:25.118932 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b73b2337-b9c8-48de-bbbd-0381a4655660 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.166249 Aug 08 00:37:25.119543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 279/563] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:24 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:25.189518 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:25.197480 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6c1ff463-e55d-4ade-bbea-74f3114850ef tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1682 microversion: 2.1 time: 0.153826 Aug 08 00:37:25.198045 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 285/564] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:25 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:25.599524 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:25.600135 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:25.606524 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:25.607001 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:25.607514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:25.608204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:25.608652 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:25.609073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:25.673094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:25.681132 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f77005af-93eb-4823-b0a8-560ce333415c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1279 microversion: 2.1 time: 0.086006 Aug 08 00:37:25.681835 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 280/565] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:25 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:25.732506 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:25.733113 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:25.740472 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:25.740956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:25.741393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:25.742091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:25.742545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:25.742972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:25.873818 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:25.881883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:25.883398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:25.884492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5b1d77b5-fb65-406b-8801-c0abd807b09c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.155847 Aug 08 00:37:25.885056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 286/566] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:25 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:26.131799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-bac49d28-dac8-4ed0-88eb-57475fb2aac7 req-29090db6-820e-4479-8b39-8a1066863c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf02d3a-b426-4135-a94a-9048d7515184", "name": "network-vif-plugged", "status": "completed", "tag": "434deac6-5c7d-4020-9d69-11e8d0ac4767"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:26.140861 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:26.141466 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:26.141594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-bac49d28-dac8-4ed0-88eb-57475fb2aac7 req-29090db6-820e-4479-8b39-8a1066863c54 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:26.142068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-bac49d28-dac8-4ed0-88eb-57475fb2aac7 req-29090db6-820e-4479-8b39-8a1066863c54 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:26.142496 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-bac49d28-dac8-4ed0-88eb-57475fb2aac7 req-29090db6-820e-4479-8b39-8a1066863c54 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:26.148003 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:26.148494 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:26.148913 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:26.149601 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:26.150049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:26.150481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:26.154472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-bac49d28-dac8-4ed0-88eb-57475fb2aac7 req-29090db6-820e-4479-8b39-8a1066863c54 service nova] Creating event network-vif-plugged:434deac6-5c7d-4020-9d69-11e8d0ac4767 for instance 0cf02d3a-b426-4135-a94a-9048d7515184 on hv-cinder-85164 Aug 08 00:37:26.159741 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-bac49d28-dac8-4ed0-88eb-57475fb2aac7 req-29090db6-820e-4479-8b39-8a1066863c54 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Aug 08 00:37:26.161480 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 281/567] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:26.220270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:26.220966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:26.227768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:26.228528 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:26.228642 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:26.229325 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:26.229770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:26.230188 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:26.307767 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:26.315725 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bb4a4422-d2d5-4837-baa8-67d30f2e2dc2 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.178864 Aug 08 00:37:26.316355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 287/568] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:26 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:26.368999 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:26.376600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e5616455-61cc-4544-b808-614754f1c299 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1682 microversion: 2.1 time: 0.160683 Aug 08 00:37:26.377106 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 282/569] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:26 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:26.701968 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:26.702584 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:26.709683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:26.712006 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:26.712006 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:26.712006 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:26.712006 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:26.712400 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:26.779975 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:26.789094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d6d94d24-1914-4a5c-87aa-fade680c0131 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1279 microversion: 2.1 time: 0.090901 Aug 08 00:37:26.789970 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 288/570] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:26 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:26.906433 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:26.907033 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:26.913631 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:26.914123 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:26.914550 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:26.915270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:26.915720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:26.918419 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:27.056277 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:27.064387 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:27.066072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:27.067958 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c01ea91b-6a34-46f5-bafb-09c12283241d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.165535 Aug 08 00:37:27.068495 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 283/571] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:26 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:37:27.336355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:27.337038 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:27.342864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:27.343380 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:27.343812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:27.344503 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:27.344952 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:27.345398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:27.400239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:27.400874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:27.407590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:27.408071 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:27.408503 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:27.409198 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:27.409648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:27.410635 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:27.535675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:27.543914 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bd5816e4-33cc-4521-8fb2-02576256b432 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.211771 Aug 08 00:37:27.544658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 289/572] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:27 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:27.655050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:27.662797 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-43f9fd9c-0d0a-4919-8ffe-396557415534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1682 microversion: 2.1 time: 0.266374 Aug 08 00:37:27.663410 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 284/573] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:27 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:27.810273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:27.810943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:27.818612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:27.819102 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:27.819567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:27.820272 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:27.820728 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:27.821157 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:28.038379 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:28.046066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8427eb58-769f-40b9-99c8-6b92f642c5b3 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1319 microversion: 2.1 time: 0.239682 Aug 08 00:37:28.046839 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 290/574] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:27 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:28.090829 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:28.091478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:28.098306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:28.098783 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:28.099255 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:28.099957 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:28.100400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:28.100818 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:28.231093 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:28.233662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=100 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:28.245477 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:28.245477 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:28.245808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1fc6b8a0-95b4-43d6-adde-e7df9a417440 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1406 microversion: 2.20 time: 0.159010 Aug 08 00:37:28.246372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 285/575] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:28 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:28.566865 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:28.568162 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:28.576005 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:28.576507 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:28.576951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:28.577674 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:28.578134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:28.578562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:28.685203 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:28.686590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:28.696543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:28.697082 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:28.697535 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:28.698250 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:28.698736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:28.699512 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:28.780551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:28.797192 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7ab086e2-4488-4690-82b2-9d932e4b8bca tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1615 microversion: 2.1 time: 0.112335 Aug 08 00:37:28.797192 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 286/576] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:28 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1615 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:28.837945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:28.858021 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cf0031a7-0ea5-46bf-90e1-08100e10dbae tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.295660 Aug 08 00:37:28.859182 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 291/577] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:28 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:28.890951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-3e5cc550-8a63-4e9b-a37f-8aabcb424171 req-1672cf8d-5235-47ee-ac75-0ac2e9e956f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b", "name": "network-vif-deleted", "tag": "6d9a7815-8cf6-4ce8-b159-82caa08091e7"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:28.902247 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-3e5cc550-8a63-4e9b-a37f-8aabcb424171 req-1672cf8d-5235-47ee-ac75-0ac2e9e956f0 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:28.903034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-3e5cc550-8a63-4e9b-a37f-8aabcb424171 req-1672cf8d-5235-47ee-ac75-0ac2e9e956f0 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:28.904952 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-3e5cc550-8a63-4e9b-a37f-8aabcb424171 req-1672cf8d-5235-47ee-ac75-0ac2e9e956f0 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:28.917598 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-3e5cc550-8a63-4e9b-a37f-8aabcb424171 req-1672cf8d-5235-47ee-ac75-0ac2e9e956f0 service nova] Creating event network-vif-deleted:6d9a7815-8cf6-4ce8-b159-82caa08091e7 for instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b on hv-cinder-85164 Aug 08 00:37:28.921780 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-3e5cc550-8a63-4e9b-a37f-8aabcb424171 req-1672cf8d-5235-47ee-ac75-0ac2e9e956f0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034432 Aug 08 00:37:28.922386 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 287/578] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:37:29.067976 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:29.068498 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:29.074700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.075266 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.075696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.076401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.076856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.077280 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.117689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-d90d5c22-0421-42d8-a2af-892f823bd820 req-a9998a60-99c6-4bdf-9084-0371575a0ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533ddba6-cc0a-4ab2-8454-0b334257c1f4", "tag": "430ffc0d-3a6e-4567-a0ef-49524240e6c5"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:29.127814 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-d90d5c22-0421-42d8-a2af-892f823bd820 req-a9998a60-99c6-4bdf-9084-0371575a0ab7 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.131953 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-d90d5c22-0421-42d8-a2af-892f823bd820 req-a9998a60-99c6-4bdf-9084-0371575a0ab7 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.131953 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-d90d5c22-0421-42d8-a2af-892f823bd820 req-a9998a60-99c6-4bdf-9084-0371575a0ab7 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.140931 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-d90d5c22-0421-42d8-a2af-892f823bd820 req-a9998a60-99c6-4bdf-9084-0371575a0ab7 service nova] Creating event network-changed:430ffc0d-3a6e-4567-a0ef-49524240e6c5 for instance 533ddba6-cc0a-4ab2-8454-0b334257c1f4 on hv-cinder-85164 Aug 08 00:37:29.150121 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-d90d5c22-0421-42d8-a2af-892f823bd820 req-a9998a60-99c6-4bdf-9084-0371575a0ab7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037383 Aug 08 00:37:29.150947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 288/579] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:29.241729 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:29.249622 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-884589da-5c36-4dba-83e9-2903ee846610 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1319 microversion: 2.1 time: 0.186209 Aug 08 00:37:29.250204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 292/580] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:29 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:29.269937 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:29.271061 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:29.278480 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.279219 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.279944 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.280811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.281418 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.281990 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.458482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:29.466979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:29.468549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:29.469742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-57385cdb-f508-404b-a8a7-fb59bd491913 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1599 microversion: 2.20 time: 0.204942 Aug 08 00:37:29.470309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 289/581] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:37:29 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1599 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:37:29.493380 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-62a4be31-979b-4d53-aa0a-a37297e31add tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:29.493871 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-62a4be31-979b-4d53-aa0a-a37297e31add tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:29.499796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62a4be31-979b-4d53-aa0a-a37297e31add tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.500288 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62a4be31-979b-4d53-aa0a-a37297e31add tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.500766 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62a4be31-979b-4d53-aa0a-a37297e31add tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.501411 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62a4be31-979b-4d53-aa0a-a37297e31add tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.501864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62a4be31-979b-4d53-aa0a-a37297e31add tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.502286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62a4be31-979b-4d53-aa0a-a37297e31add tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.581202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-62a4be31-979b-4d53-aa0a-a37297e31add tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091602 Aug 08 00:37:29.586242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 293/582] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Aug 8 00:37:29 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 08 00:37:29.815053 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:29.815715 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:29.822094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.822599 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.823041 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.823799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.824259 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.824688 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.864516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:29.870985 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.875850 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.876294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.876762 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'fault' on Instance uuid 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:29.882923 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:29.884874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:29.891930 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.892227 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.892737 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:29.893457 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:29.893900 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:29.894873 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:30.009466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:30.023143 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-49867949-2d4d-4fba-8088-ad71c1165582 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 200 len: 1332 microversion: 2.1 time: 0.208754 Aug 08 00:37:30.025281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 290/583] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:29 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 1332 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:30.198820 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:30.216984 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-57eb4c46-edfc-4b13-9275-2b078b3b0178 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.338341 Aug 08 00:37:30.229299 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 294/584] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:29 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:30.274225 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:30.275014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:30.281685 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:30.282171 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:30.282609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:30.283337 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:30.283792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:30.284218 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:30.447371 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:30.457329 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5182549b-e9a7-436c-bdc7-fa6b88c33651 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1319 microversion: 2.1 time: 0.189898 Aug 08 00:37:30.470867 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 291/585] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:30 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:30.938370 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-7e53bafa-798b-420f-8478-fad257734dee req-980e25f8-364e-4621-8ec4-2d620fa59801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf02d3a-b426-4135-a94a-9048d7515184", "tag": "434deac6-5c7d-4020-9d69-11e8d0ac4767"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:30.949302 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-7e53bafa-798b-420f-8478-fad257734dee req-980e25f8-364e-4621-8ec4-2d620fa59801 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:30.949784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-7e53bafa-798b-420f-8478-fad257734dee req-980e25f8-364e-4621-8ec4-2d620fa59801 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:30.950217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-7e53bafa-798b-420f-8478-fad257734dee req-980e25f8-364e-4621-8ec4-2d620fa59801 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:30.962632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-7e53bafa-798b-420f-8478-fad257734dee req-980e25f8-364e-4621-8ec4-2d620fa59801 service nova] Creating event network-changed:434deac6-5c7d-4020-9d69-11e8d0ac4767 for instance 0cf02d3a-b426-4135-a94a-9048d7515184 on hv-cinder-85164 Aug 08 00:37:30.967787 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-7e53bafa-798b-420f-8478-fad257734dee req-980e25f8-364e-4621-8ec4-2d620fa59801 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033532 Aug 08 00:37:30.968417 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 295/586] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:31.049684 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:31.050305 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:31.056367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:31.056854 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:31.057296 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:31.057998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:31.058478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:31.059096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:31.073108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b HTTP/1.1 Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:37:31.074753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:37:31.076331 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b'} Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:37:31.077227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:37:31.078736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:37:31.080120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:37:31.080120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1f49264c-4646-4a54-937e-ad16938f777d tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 404 len: 111 microversion: 2.1 time: 0.030863 Aug 08 00:37:31.080318 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 292/587] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:31 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:37:31.086610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-20a87562-eb81-4c67-84f2-2406ccc72184 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '.version_select at 0x7fd1a1fa4700>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:31.099209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:31.194680 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-20a87562-eb81-4c67-84f2-2406ccc72184 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188546736" status: 202 len: 0 microversion: 2.1 time: 0.113078 Aug 08 00:37:31.195261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 296/588] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 8 00:37:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188546736 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:37:31.240691 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:31.241429 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:31.247773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:31.248251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:31.248778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:31.249543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:31.250028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:31.250496 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:31.432860 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:31.442473 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-850120c2-a8e9-46ba-95ed-62a773f1604c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.205980 Aug 08 00:37:31.443177 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 293/589] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:31 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:31.499758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:31.501879 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:31.511283 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:31.520014 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:31.520014 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:31.520014 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:31.520014 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:31.523337 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:31.789918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:31.798326 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-51d40536-ea71-4095-a57c-6d1329d006c6 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1319 microversion: 2.1 time: 0.317910 Aug 08 00:37:31.812419 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 297/590] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:31 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:32.267953 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:32.268406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:32.275687 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:32.276269 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:32.276938 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:32.277776 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:32.278335 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:32.278825 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:32.362014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'services' on Instance uuid 728de657-b1e9-4f61-8dcf-d5cc9553eb16 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:32.464330 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:32.465037 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:32.471604 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:32.472203 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:32.472712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:32.473600 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:32.474061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:32.474491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:32.627967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-18599bbc-4fb1-4e56-95ea-f011c54ed957 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments/598ed45f-b1a0-496e-bd65-ba5a95643e5e" status: 202 len: 0 microversion: 2.1 time: 0.363723 Aug 08 00:37:32.634496 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 294/591] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:37:32 2022] DELETE /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments/598ed45f-b1a0-496e-bd65-ba5a95643e5e => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:37:32.652015 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:32.658610 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-66cf93e8-4f38-48d3-b141-fe2008041984 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:32.680176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5c2fef8e-cba2-422b-990e-3663df0da6bf tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.219545 Aug 08 00:37:32.681769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 298/592] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:32 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:32.682570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-66cf93e8-4f38-48d3-b141-fe2008041984 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:32.689801 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-66cf93e8-4f38-48d3-b141-fe2008041984 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:32.693527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-66cf93e8-4f38-48d3-b141-fe2008041984 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:32.693527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-66cf93e8-4f38-48d3-b141-fe2008041984 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:32.693527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-66cf93e8-4f38-48d3-b141-fe2008041984 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:32.693527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-66cf93e8-4f38-48d3-b141-fe2008041984 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:32.693901 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-66cf93e8-4f38-48d3-b141-fe2008041984 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:32.726471 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-66cf93e8-4f38-48d3-b141-fe2008041984 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072176 Aug 08 00:37:32.727339 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 295/593] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:37:32 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:32.820937 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:32.821962 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:32.828593 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:32.829263 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:32.829689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:32.830543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:32.830986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:32.831513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:32.962457 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:32.969817 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cb8d162b-4a11-44ed-9556-157c958e8bc8 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1319 microversion: 2.1 time: 0.154218 Aug 08 00:37:32.970402 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 299/594] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:32 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:33.702996 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:33.703635 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:33.710478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:33.713319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:33.713319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:33.713319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:33.713319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:33.713746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:33.739460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-30cf7160-87d4-41eb-8eaa-3919fc73c9c9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:33.746192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-30cf7160-87d4-41eb-8eaa-3919fc73c9c9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:33.746192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:33.746192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=8 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:33.749432 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30cf7160-87d4-41eb-8eaa-3919fc73c9c9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:33.749918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30cf7160-87d4-41eb-8eaa-3919fc73c9c9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:33.750349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30cf7160-87d4-41eb-8eaa-3919fc73c9c9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:33.751095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30cf7160-87d4-41eb-8eaa-3919fc73c9c9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:33.751556 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30cf7160-87d4-41eb-8eaa-3919fc73c9c9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:33.751982 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-30cf7160-87d4-41eb-8eaa-3919fc73c9c9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:33.783207 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-30cf7160-87d4-41eb-8eaa-3919fc73c9c9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048181 Aug 08 00:37:33.788655 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 300/595] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:37:33 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:37:33.868339 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:33.876771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-76339d3d-adae-4084-91f7-f2cc79c54312 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1755 microversion: 2.1 time: 0.177652 Aug 08 00:37:33.877467 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 296/596] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:33 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:33.990690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:33.991359 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:33.998378 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:33.998861 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:33.999334 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:34.000028 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:34.000474 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:34.000895 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:34.132811 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:34.140618 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f12a5a34-c7b7-48ff-a867-3dd47ca5d4da tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1319 microversion: 2.1 time: 0.154536 Aug 08 00:37:34.143907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 301/597] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:33 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:34.192211 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-2bcc6e83-2ca9-414d-a4c6-75b33ac12792 req-f2665ed6-f316-4571-badb-521833734af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533ddba6-cc0a-4ab2-8454-0b334257c1f4", "name": "network-vif-plugged", "status": "completed", "tag": "430ffc0d-3a6e-4567-a0ef-49524240e6c5"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:34.201636 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2bcc6e83-2ca9-414d-a4c6-75b33ac12792 req-f2665ed6-f316-4571-badb-521833734af8 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:34.202106 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2bcc6e83-2ca9-414d-a4c6-75b33ac12792 req-f2665ed6-f316-4571-badb-521833734af8 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:34.202529 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2bcc6e83-2ca9-414d-a4c6-75b33ac12792 req-f2665ed6-f316-4571-badb-521833734af8 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:34.215576 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-2bcc6e83-2ca9-414d-a4c6-75b33ac12792 req-f2665ed6-f316-4571-badb-521833734af8 service nova] Creating event network-vif-plugged:430ffc0d-3a6e-4567-a0ef-49524240e6c5 for instance 533ddba6-cc0a-4ab2-8454-0b334257c1f4 on hv-cinder-85164 Aug 08 00:37:34.220353 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-2bcc6e83-2ca9-414d-a4c6-75b33ac12792 req-f2665ed6-f316-4571-badb-521833734af8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032047 Aug 08 00:37:34.220933 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 297/598] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:34.796535 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9fe7de6e-0360-46ec-9154-52af3a94ce27 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:34.798641 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9fe7de6e-0360-46ec-9154-52af3a94ce27 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:34.805183 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9fe7de6e-0360-46ec-9154-52af3a94ce27 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:34.805657 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9fe7de6e-0360-46ec-9154-52af3a94ce27 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:34.806092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9fe7de6e-0360-46ec-9154-52af3a94ce27 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:34.806782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9fe7de6e-0360-46ec-9154-52af3a94ce27 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:34.807264 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9fe7de6e-0360-46ec-9154-52af3a94ce27 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:34.807710 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9fe7de6e-0360-46ec-9154-52af3a94ce27 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:34.811430 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:34.837711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9fe7de6e-0360-46ec-9154-52af3a94ce27 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045054 Aug 08 00:37:34.838278 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 302/599] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:37:34 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 00:37:34.898711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:34.899202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:34.899479 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:34.900171 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:34.906023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:34.906258 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:34.906504 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:34.906794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:34.906931 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:34.907254 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:34.907649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:34.907932 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:34.908096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:34.908376 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:34.908514 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:34.908791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:34.933328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:37:35.055478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:35.063630 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b08945c6-17e2-4564-b762-a780c7e3497e tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1758 microversion: 2.1 time: 0.169374 Aug 08 00:37:35.064204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 298/600] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:34 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:35.161036 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:35.161660 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:35.167819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:35.168297 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:35.168752 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:35.169419 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:35.169870 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:35.170292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:35.220981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d0f5c61d-6af9-49cc-989c-2d2e5ceeed05 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 204 len: 0 microversion: 2.1 time: 0.326291 Aug 08 00:37:35.221569 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 303/601] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:37:34 2022] DELETE /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 00:37:35.230377 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:35.231107 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:35.237160 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:35.254716 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:35.254716 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:35.254716 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:35.254716 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:35.255332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:35.303384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:35.310851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ffd7fdbe-b9bb-45a5-8ac5-a5108a135060 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1319 microversion: 2.1 time: 0.153684 Aug 08 00:37:35.311460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 299/602] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:35 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:35.371646 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:35.379075 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3e955808-5bfa-4c62-9360-6b1da21a9c32 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1683 microversion: 2.1 time: 0.152949 Aug 08 00:37:35.379703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 304/603] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:35 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:35.757018 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:35.757613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:35.765407 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:35.765988 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:35.766547 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:35.767433 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:35.767978 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:35.768758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:35.849943 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lazy-loading 'services' on Instance uuid 8220eb97-0920-4393-9354-094c2f62cc94 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:36.037537 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e3661949-1c74-4233-90d8-0ad94d1c967e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments/7b8841f7-1374-4bcf-91f8-6fd443037e84" status: 202 len: 0 microversion: 2.1 time: 0.284918 Aug 08 00:37:36.038189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 300/604] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:37:35 2022] DELETE /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments/7b8841f7-1374-4bcf-91f8-6fd443037e84 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:37:36.046625 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8f7ddb10-b1a9-4663-a78b-fa0ffa13f4fc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:36.048927 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8f7ddb10-b1a9-4663-a78b-fa0ffa13f4fc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:36.055589 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f7ddb10-b1a9-4663-a78b-fa0ffa13f4fc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:36.056020 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f7ddb10-b1a9-4663-a78b-fa0ffa13f4fc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:36.056461 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f7ddb10-b1a9-4663-a78b-fa0ffa13f4fc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:36.057155 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f7ddb10-b1a9-4663-a78b-fa0ffa13f4fc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:36.057611 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f7ddb10-b1a9-4663-a78b-fa0ffa13f4fc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:36.058046 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8f7ddb10-b1a9-4663-a78b-fa0ffa13f4fc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:36.088038 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8f7ddb10-b1a9-4663-a78b-fa0ffa13f4fc tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Aug 08 00:37:36.088529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 305/605] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:37:36 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:36.334017 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:36.335766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:36.340879 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:36.341351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:36.341782 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:36.342463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:36.342908 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:36.343353 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:36.401872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:36.402486 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:36.408714 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:36.409197 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:36.409854 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:36.410548 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:36.411111 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:36.411572 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:36.478259 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:36.486089 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-119c2864-c84b-4a5e-8263-d30c7d6e1b02 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1319 microversion: 2.1 time: 0.157504 Aug 08 00:37:36.486664 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 301/606] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:36 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:36.543315 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:36.550690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-21257468-0ccc-4ce8-ade8-927de3213201 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1683 microversion: 2.1 time: 0.153010 Aug 08 00:37:36.551826 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 306/607] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:36 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:37.101019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f0fb3143-9ca6-43ed-bd74-891687a77c7c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:37.103391 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f0fb3143-9ca6-43ed-bd74-891687a77c7c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:37.109785 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0fb3143-9ca6-43ed-bd74-891687a77c7c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:37.110259 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0fb3143-9ca6-43ed-bd74-891687a77c7c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:37.110688 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0fb3143-9ca6-43ed-bd74-891687a77c7c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:37.111403 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0fb3143-9ca6-43ed-bd74-891687a77c7c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:37.111853 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0fb3143-9ca6-43ed-bd74-891687a77c7c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:37.112272 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0fb3143-9ca6-43ed-bd74-891687a77c7c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:37.141671 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f0fb3143-9ca6-43ed-bd74-891687a77c7c tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Aug 08 00:37:37.142229 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 302/608] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:37:37 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:37:37.507430 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:37.508039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:37.514717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:37.515198 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:37.515668 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:37.516355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:37.516804 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:37.517225 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:37.572380 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:37.573102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:37.579023 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:37.579553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:37.579998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:37.580665 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:37.581110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:37.581527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:37.597165 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:37.649703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:37.657271 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-39f4e4b5-bac1-4b16-bc77-bf3f9ef6bb03 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1508 microversion: 2.1 time: 0.153757 Aug 08 00:37:37.657845 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 307/609] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:37 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:37.677728 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1e7fdd55-1229-4352-a5c2-6fca911a1d2a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5001fa15-133c-47ff-9473-237f8cdfa67c", "device": "/dev/sdb"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:37.680113 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1e7fdd55-1229-4352-a5c2-6fca911a1d2a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:37.686018 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e7fdd55-1229-4352-a5c2-6fca911a1d2a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:37.686494 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e7fdd55-1229-4352-a5c2-6fca911a1d2a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:37.686924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e7fdd55-1229-4352-a5c2-6fca911a1d2a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:37.687653 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e7fdd55-1229-4352-a5c2-6fca911a1d2a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:37.688102 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e7fdd55-1229-4352-a5c2-6fca911a1d2a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:37.688526 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1e7fdd55-1229-4352-a5c2-6fca911a1d2a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:37.717619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:37.725635 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-bffe7907-a292-413d-a088-dee6f53b04ea tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1683 microversion: 2.1 time: 0.157019 Aug 08 00:37:37.726165 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 303/610] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:37 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:38.154338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1364ab8c-01d7-4ee7-9c4c-14e5a28a7461 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:38.156618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1364ab8c-01d7-4ee7-9c4c-14e5a28a7461 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:38.163037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1364ab8c-01d7-4ee7-9c4c-14e5a28a7461 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:38.163549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1364ab8c-01d7-4ee7-9c4c-14e5a28a7461 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:38.163987 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1364ab8c-01d7-4ee7-9c4c-14e5a28a7461 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:38.164690 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1364ab8c-01d7-4ee7-9c4c-14e5a28a7461 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:38.165140 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1364ab8c-01d7-4ee7-9c4c-14e5a28a7461 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:38.165563 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1364ab8c-01d7-4ee7-9c4c-14e5a28a7461 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:38.194772 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1364ab8c-01d7-4ee7-9c4c-14e5a28a7461 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Aug 08 00:37:38.195343 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 304/611] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:37:38 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:37:38.746170 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:38.746706 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:38.753444 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:38.753598 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:38.753962 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:38.755272 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:38.755677 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:38.756168 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:38.983189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:38.991889 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-35e9ca3c-dc57-42da-854e-f311a57849d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1683 microversion: 2.1 time: 0.249798 Aug 08 00:37:38.992666 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 305/612] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:38 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1683 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:39.103513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1e7fdd55-1229-4352-a5c2-6fca911a1d2a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "POST /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.424938 Aug 08 00:37:39.103513 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 308/613] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:37:37 2022] POST /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4/os-volume_attachments => generated 194 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:37:39.208392 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7d6b2008-8bfe-4ee4-bdac-364c74c07026 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:39.210849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7d6b2008-8bfe-4ee4-bdac-364c74c07026 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:39.217639 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d6b2008-8bfe-4ee4-bdac-364c74c07026 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:39.218592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d6b2008-8bfe-4ee4-bdac-364c74c07026 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:39.219115 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d6b2008-8bfe-4ee4-bdac-364c74c07026 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:39.219851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d6b2008-8bfe-4ee4-bdac-364c74c07026 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:39.220393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d6b2008-8bfe-4ee4-bdac-364c74c07026 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:39.220825 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7d6b2008-8bfe-4ee4-bdac-364c74c07026 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:39.255019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7d6b2008-8bfe-4ee4-bdac-364c74c07026 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051722 Aug 08 00:37:39.256299 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 306/614] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:37:39 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 08 00:37:39.344494 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:39.345081 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:39.351529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:39.352049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:39.352686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:39.353401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:39.354070 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:39.354504 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:39.383123 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:37:39.396661 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-4d0a2dd0-7a8f-4109-843e-7f3a4ae4f23e req-0fd3a388-f602-471d-8363-c1dc89d60297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728de657-b1e9-4f61-8dcf-d5cc9553eb16", "name": "network-vif-deleted", "tag": "32463a74-b851-44eb-9dbb-f33e871b6327"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:39.406386 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-4d0a2dd0-7a8f-4109-843e-7f3a4ae4f23e req-0fd3a388-f602-471d-8363-c1dc89d60297 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:39.407258 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-4d0a2dd0-7a8f-4109-843e-7f3a4ae4f23e req-0fd3a388-f602-471d-8363-c1dc89d60297 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:39.407782 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-4d0a2dd0-7a8f-4109-843e-7f3a4ae4f23e req-0fd3a388-f602-471d-8363-c1dc89d60297 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:39.419655 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-4d0a2dd0-7a8f-4109-843e-7f3a4ae4f23e req-0fd3a388-f602-471d-8363-c1dc89d60297 service nova] Creating event network-vif-deleted:32463a74-b851-44eb-9dbb-f33e871b6327 for instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 on hv-cinder-85164 Aug 08 00:37:39.424693 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-4d0a2dd0-7a8f-4109-843e-7f3a4ae4f23e req-0fd3a388-f602-471d-8363-c1dc89d60297 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032762 Aug 08 00:37:39.425362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 307/615] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:37:39.722108 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-40cf77d5-79a6-4ead-ad30-c1bb454d8796 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 204 len: 0 microversion: 2.1 time: 0.381435 Aug 08 00:37:39.722965 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 309/616] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:37:39 2022] DELETE /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:37:39.731995 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:39.732728 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:39.739674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:39.740169 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:39.740609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:39.741317 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:39.741770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:39.742237 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:39.875564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:39.883736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-af3e9bee-fa15-4820-a4f4-c98151d3cb9f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1688 microversion: 2.1 time: 0.155974 Aug 08 00:37:39.884310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 308/617] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:39 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:40.013742 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:40.014474 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:40.020610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:40.021089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:40.021557 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:40.022261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:40.022706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:40.023118 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:40.057625 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:40.057794 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:40.058397 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:40.058732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'fault' on Instance uuid 728de657-b1e9-4f61-8dcf-d5cc9553eb16 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:40.103169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:40.110950 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-56f393f8-feda-42a0-8a0d-59b161bd4768 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1332 microversion: 2.1 time: 0.101467 Aug 08 00:37:40.111732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 310/618] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:40 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:40.905452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:40.906073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:40.912963 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:40.913452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:40.913892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:40.914590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:40.915045 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:40.915497 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:41.047462 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:41.055579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-217eb831-1602-406c-bf14-600043380452 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1688 microversion: 2.1 time: 0.154034 Aug 08 00:37:41.056158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 309/619] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:40 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:41.132986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:41.133703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:41.139991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:41.140463 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:41.140903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:41.141573 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:41.142018 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:41.142433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:41.171823 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:41.172223 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:41.172652 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:41.173090 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'fault' on Instance uuid 728de657-b1e9-4f61-8dcf-d5cc9553eb16 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:41.217424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:41.224951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-31b4d199-cdeb-4b79-a2c6-d9c56480f706 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1332 microversion: 2.1 time: 0.096387 Aug 08 00:37:41.225547 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 311/620] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:41 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:42.077266 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:42.077880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:42.084558 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:42.085039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:42.085474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:42.087013 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:42.087494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:42.087924 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:42.215651 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:42.223209 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-633bce2f-5a2f-4f8f-ae5a-1b74fe2e90eb tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1688 microversion: 2.1 time: 0.149751 Aug 08 00:37:42.223798 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 310/621] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:42 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:42.244393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:42.244996 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:42.251309 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:42.251785 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:42.252215 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:42.252894 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:42.253341 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:42.253757 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:42.284095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:42.284609 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:42.285003 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:42.285438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'fault' on Instance uuid 728de657-b1e9-4f61-8dcf-d5cc9553eb16 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:42.326362 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:42.334107 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ad5d00a3-21aa-4883-a43d-44f2bc4ae455 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1332 microversion: 2.1 time: 0.093303 Aug 08 00:37:42.334660 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 312/622] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:42 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:43.244375 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:43.245025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:43.251548 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:43.252021 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:43.252451 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:43.253134 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:43.253579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:43.254000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:43.356204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:43.356867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:43.362695 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:43.363186 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:43.363672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:43.365016 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:43.365491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:43.365922 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:43.371029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:43.389202 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:43.396739 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0ba9d208-02e6-4337-8015-a04af4087ff0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1688 microversion: 2.1 time: 0.156416 Aug 08 00:37:43.397302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 311/623] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:43 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:43.406588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:43.407072 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:43.407534 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:43.407979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'fault' on Instance uuid 728de657-b1e9-4f61-8dcf-d5cc9553eb16 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:43.449864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:43.457378 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-173f9cab-0137-419f-a58c-0c5f6489a9c4 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 200 len: 1332 microversion: 2.1 time: 0.106106 Aug 08 00:37:43.457941 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 313/624] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:43 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:44.419847 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:44.420574 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:44.426963 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:44.427506 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:44.427925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:44.428627 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:44.429077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:44.430229 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:44.481322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:44.483264 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:44.492291 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:44.495668 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:44.496686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:44.498880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:44.498880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:44.499529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:44.516491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 HTTP/1.1 Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:37:44.518057 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:37:44.519406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '728de657-b1e9-4f61-8dcf-d5cc9553eb16'} Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:37:44.520167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:37:44.521347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:44.522443 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:37:44.522443 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a50dd674-ce41-48c2-91b1-5c55c55fa400 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 404 len: 111 microversion: 2.1 time: 0.043292 Aug 08 00:37:44.522443 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 314/625] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:44 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:37:44.528518 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e9e0f0bc-be4a-42c2-aaf7-492b67f18e87 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '.version_select at 0x7fd1a1f5f310>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:44.547969 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:44.556145 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-dcb315d9-e19d-45e9-8449-71ba6f6b14b0 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1620 microversion: 2.1 time: 0.141054 Aug 08 00:37:44.558130 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 312/626] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:44 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1620 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:44.616441 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e9e0f0bc-be4a-42c2-aaf7-492b67f18e87 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414492894" status: 202 len: 0 microversion: 2.1 time: 0.091485 Aug 08 00:37:44.621031 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 315/627] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Aug 8 00:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414492894 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:37:44.770786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-c5cf0c9c-66d1-4709-8abc-d617e6f36fa2 req-6648788e-2f7c-4e93-8e57-fd40ecebd2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8220eb97-0920-4393-9354-094c2f62cc94", "name": "network-vif-deleted", "tag": "bd00c5d4-343c-4fc4-b81d-fc55458cef59"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:44.780407 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-c5cf0c9c-66d1-4709-8abc-d617e6f36fa2 req-6648788e-2f7c-4e93-8e57-fd40ecebd2dd service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:44.780886 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-c5cf0c9c-66d1-4709-8abc-d617e6f36fa2 req-6648788e-2f7c-4e93-8e57-fd40ecebd2dd service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:44.781323 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-c5cf0c9c-66d1-4709-8abc-d617e6f36fa2 req-6648788e-2f7c-4e93-8e57-fd40ecebd2dd service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:44.793221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-c5cf0c9c-66d1-4709-8abc-d617e6f36fa2 req-6648788e-2f7c-4e93-8e57-fd40ecebd2dd service nova] Creating event network-vif-deleted:bd00c5d4-343c-4fc4-b81d-fc55458cef59 for instance 8220eb97-0920-4393-9354-094c2f62cc94 on hv-cinder-85164 Aug 08 00:37:44.798257 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-c5cf0c9c-66d1-4709-8abc-d617e6f36fa2 req-6648788e-2f7c-4e93-8e57-fd40ecebd2dd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031311 Aug 08 00:37:44.798938 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 313/628] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:45.449342 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-704b1c14-9714-4ff7-98af-69c9cb639ea9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: .version_select at 0x7fd1a1eef820>, body: {"keypair": {"name": "tempest-keypair-262890952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBVSEngfrs29E6DpIEgUc9LCvhWJG+kbRMpGZADssKBbHUkNYREy6/XWAP0OCw/xCKbIspbP0SW3QU4nB0ikDWpoJyQ27JUZJ1IjRM/sgJcuw2Ys7UCANJ1fcDzxs/DbQ=="}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:45.471623 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-704b1c14-9714-4ff7-98af-69c9cb639ea9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for project e97eb34021d44eb0a99763034c1e9e87. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:37:45.476282 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-704b1c14-9714-4ff7-98af-69c9cb639ea9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for user 7b317f585f8a4da3abe24ab5cf4ee0c0 and project e97eb34021d44eb0a99763034c1e9e87. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:37:45.568374 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-704b1c14-9714-4ff7-98af-69c9cb639ea9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123350 Aug 08 00:37:45.568950 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 316/629] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:37:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:37:45.577734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:45.578433 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:45.587105 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:45.587637 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:45.590278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:45.590278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:45.590278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:45.590278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:45.625764 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:45.626250 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:45.626689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:45.627133 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lazy-loading 'fault' on Instance uuid 8220eb97-0920-4393-9354-094c2f62cc94 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:37:45.682279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:45.690553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fe6a2bb4-d9d2-40f3-9922-82d385db5e49 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 200 len: 1334 microversion: 2.1 time: 0.117068 Aug 08 00:37:45.691136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 314/630] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:45 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 1334 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:46.714741 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:46.715330 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8220eb97-0920-4393-9354-094c2f62cc94] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:46.721227 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:46.721769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:46.722208 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:46.722895 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:46.723382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:46.723812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:46.737037 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] HTTP exception thrown: Instance 8220eb97-0920-4393-9354-094c2f62cc94 could not be found. Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Request method failure captured: Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 HTTP/1.1 Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FmiSdbrB2DQZbEo_7DUiSWc_4dae8wGG5xoFF5XZW8ovdJ5Pc-0c4-PyjQUjY4ASLkMp8v9RZbQw52NYnVCxcI5HiJA30AQUXRi0xuHJal7gwJJpJT0uN2V2ZaWbeHIZd479JeoVYQI2OaPhELhP0Lhs3-4ZUcVAzxMiEhitsXyfTo Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:37:46.738553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: c0aa06eea99f4011ab85ec51b0e60f2c Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 8220eb97-0920-4393-9354-094c2f62cc94 could not be found. Aug 08 00:37:46.742892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '8220eb97-0920-4393-9354-094c2f62cc94'} Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8220eb97-0920-4393-9354-094c2f62cc94 could not be found. Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:37:46.743883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8220eb97-0920-4393-9354-094c2f62cc94 could not be found. Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8220eb97-0920-4393-9354-094c2f62cc94 could not be found. Aug 08 00:37:46.745307 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:37:46.746612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Returning 404 to user: Instance 8220eb97-0920-4393-9354-094c2f62cc94 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:37:46.746612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-7ef54f25-fdbd-43eb-90ca-3438cd808db3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94" status: 404 len: 111 microversion: 2.1 time: 0.030318 Aug 08 00:37:46.746612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 317/631] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:46 2022] GET /compute/v2.1/servers/8220eb97-0920-4393-9354-094c2f62cc94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:37:46.748960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-540ddebe-0641-4ca0-b816-ded4e153f048 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '.version_select at 0x7fd1a1df61f0>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:46.856071 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-540ddebe-0641-4ca0-b816-ded4e153f048 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910571370" status: 202 len: 0 microversion: 2.1 time: 0.110903 Aug 08 00:37:46.856658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 315/632] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 8 00:37:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910571370 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:37:47.967308 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-321192681", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5ea35fc-5529-4ec7-b035-b5f2637c5acc"}], "security_groups": [{"name": "tempest-securitygroup--1386842020"}], "key_name": "tempest-keypair-262890952", "user_data": "}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:48.073754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] validate_networks() for [('a5ea35fc-5529-4ec7-b035-b5f2637c5acc', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:37:48.736157 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:37:48.736695 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:37:48.737387 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:37:48.737799 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:37:48.738212 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:37:48.747920 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:48.748416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:48.748849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:48.749600 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:48.750052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:48.750473 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:48.766980 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for project e97eb34021d44eb0a99763034c1e9e87. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:37:48.770940 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for user 7b317f585f8a4da3abe24ab5cf4ee0c0 and project e97eb34021d44eb0a99763034c1e9e87. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:37:48.782206 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:37:48.784566 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:37:48.947852 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b027a4b0-9e21-402a-8f56-3f7498a51cb1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.984654 Aug 08 00:37:48.948419 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 318/633] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:37:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:37:48.959969 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4a6e0159-668f-4318-9873-d250685c21d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:48.960699 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4a6e0159-668f-4318-9873-d250685c21d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:49.020061 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-4a6e0159-668f-4318-9873-d250685c21d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:49.027597 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4a6e0159-668f-4318-9873-d250685c21d5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1240 microversion: 2.1 time: 0.072268 Aug 08 00:37:49.028167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 316/634] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:48 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:50.049261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:50.049795 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:50.056363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:50.056829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:50.057264 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:50.057941 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:50.058386 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:50.058835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:50.122532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:50.129964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e4550c36-d342-4079-aeb8-7b52ba6e2141 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1244 microversion: 2.1 time: 0.085152 Aug 08 00:37:50.130518 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 319/635] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:50 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:50.385968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:50.388720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:50.392997 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:50.393473 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:50.393904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:50.394591 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:50.395036 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:50.395519 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:50.420896 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Going to try to terminate instance {{(pid=130172) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:37:50.706662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-262200ac-a48d-4e4f-b1e7-ee8d50ec9590 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 204 len: 0 microversion: 2.1 time: 0.324844 Aug 08 00:37:50.708203 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 317/636] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:37:50 2022] DELETE /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:37:50.716633 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:50.717235 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:50.723152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:50.723674 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:50.724111 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:50.724852 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:50.725306 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:50.725732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:50.854388 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:50.861848 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-561d3f09-7dc5-4bbb-b8fb-50e1988b9d57 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1508 microversion: 2.1 time: 0.149019 Aug 08 00:37:50.862411 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 320/637] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:50 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:51.151682 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:51.152379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:51.158334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:51.158807 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:51.159251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:51.159939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:51.160391 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:51.160811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:51.222653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:51.230624 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-514b9e27-dcd9-4e5b-bfc3-24888b79070b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1292 microversion: 2.1 time: 0.083500 Aug 08 00:37:51.231186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 318/638] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:51 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:51.883957 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:51.884560 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:51.890947 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:51.891464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:51.891901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:51.892599 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:51.893051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:51.893507 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:52.020283 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:52.028288 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-daa59ae4-a5fd-4249-97a2-15bdf54a494f tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1508 microversion: 2.1 time: 0.148818 Aug 08 00:37:52.028840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 321/639] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:51 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:52.251842 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:52.252359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:52.259353 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:52.259826 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:52.260254 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:52.260933 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:52.261376 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:52.261792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:52.323320 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:52.330866 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d5c28710-383e-4c1e-b31e-2152ce4f476b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1292 microversion: 2.1 time: 0.082863 Aug 08 00:37:52.331461 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 319/640] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:52 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:53.048998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:53.049510 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:53.051887 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:53.056702 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:53.057184 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:53.057621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:53.058317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:53.058771 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:53.059252 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:53.191600 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:53.199045 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-279085a0-ad3b-4580-bd6a-fd20990dc94d tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1508 microversion: 2.1 time: 0.154213 Aug 08 00:37:53.199640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 322/641] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:53 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:53.351265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:53.351871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:53.358344 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:53.358824 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:53.359269 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:53.359962 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:53.360403 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:53.360822 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:53.423174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:53.430673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a7b55c13-9cef-4ca2-a8e8-9f6165e74fdd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1292 microversion: 2.1 time: 0.083206 Aug 08 00:37:53.431249 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 320/642] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:53 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:54.220982 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:54.221682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:54.227960 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:54.228436 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:54.229375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:54.230064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:54.230508 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:54.230927 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:54.358223 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:54.365564 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3bfd47a2-24c8-48b3-a8a1-4a51cb99ab11 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1508 microversion: 2.1 time: 0.148397 Aug 08 00:37:54.366121 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 323/643] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:54 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:54.450998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:54.451651 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:54.458416 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:54.459152 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:54.459622 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:54.460310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:54.460757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:54.461172 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:54.477374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:54.529296 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:54.537234 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-bb94c9fd-6adf-4b7a-b7bc-4d42c11880e9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1292 microversion: 2.1 time: 0.090120 Aug 08 00:37:54.537807 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 321/644] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:54 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:55.385878 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:55.386466 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:55.393456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:55.393929 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:55.394358 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:55.395046 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:55.395524 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:55.395948 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:55.531834 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:55.539279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d96c404b-f7ee-4d5c-aa67-d107dd58dbe1 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1508 microversion: 2.1 time: 0.157194 Aug 08 00:37:55.539841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 324/645] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:55 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:55.558130 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:55.558958 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:55.565775 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:55.566260 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:55.566694 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:55.567413 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:55.567865 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:55.572102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:55.630327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:55.638470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e909aaa9-3285-4631-9848-73a1c7f47002 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1292 microversion: 2.1 time: 0.084492 Aug 08 00:37:55.639014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 322/646] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:55 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:56.565580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:56.566161 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:56.572496 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:56.572977 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:56.573404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:56.574110 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:56.574558 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:56.575059 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:56.658897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:56.659904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:56.665547 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:56.666031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:56.666672 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:56.667544 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:56.668004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:56.668438 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:56.713323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:56.721772 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f7996518-f0c2-4971-b61a-a970a6699568 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1508 microversion: 2.1 time: 0.159979 Aug 08 00:37:56.722342 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 325/647] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:56 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:56.730615 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:56.738786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-24cd531b-244d-406e-aca8-810a8546d335 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1292 microversion: 2.1 time: 0.083750 Aug 08 00:37:56.739372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 323/648] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:56 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:57.743489 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:57.744095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:57.751176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:57.755552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:57.755552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:57.755552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:57.755552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:57.755928 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:57.759166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:57.759846 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:57.766411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:57.766932 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:57.767422 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:57.768122 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:57.768567 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:57.768992 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:57.832128 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:57.840183 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ee00100f-a8b6-4e1c-ab70-d896588dda90 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1292 microversion: 2.1 time: 0.084774 Aug 08 00:37:57.840763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 324/649] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:57 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:57.885202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:57.892833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-abf69e80-9dc6-4ac9-a94d-b30454a1b1be tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1508 microversion: 2.1 time: 0.153187 Aug 08 00:37:57.893397 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 326/650] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:57 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:58.860977 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:58.861586 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:58.868604 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:58.873836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:58.874984 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:58.876119 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:58.878170 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:58.885460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:58.915080 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:37:58.916878 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:37:58.923552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:58.924347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=10 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:58.926020 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:58.926503 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:58.927056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:58.927789 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:58.928237 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:58.928808 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:58.988597 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:58.996715 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9ed45da7-026e-4430-a80e-a3351eb3dac7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1310 microversion: 2.1 time: 0.140024 Aug 08 00:37:59.000043 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 325/651] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:58 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1310 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:37:59.164061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:37:59.174664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ec37faef-ce2b-4bc1-87b8-da5aa0789064 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1508 microversion: 2.1 time: 0.264585 Aug 08 00:37:59.175272 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 327/652] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:37:58 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:37:59.348762 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:37:59.417047 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-e4e2fd68-50fb-4b28-aed5-f0e25c12570d req-28865234-877c-40ea-b424-4d014cdb8606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8480cf-4061-4c55-8118-a74951cf6142", "name": "network-vif-deleted", "tag": "247bdc76-37cc-4751-82b6-e4aaca65e313"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:37:59.427422 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-e4e2fd68-50fb-4b28-aed5-f0e25c12570d req-28865234-877c-40ea-b424-4d014cdb8606 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:37:59.427900 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-e4e2fd68-50fb-4b28-aed5-f0e25c12570d req-28865234-877c-40ea-b424-4d014cdb8606 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:37:59.428379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-e4e2fd68-50fb-4b28-aed5-f0e25c12570d req-28865234-877c-40ea-b424-4d014cdb8606 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:37:59.440162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-e4e2fd68-50fb-4b28-aed5-f0e25c12570d req-28865234-877c-40ea-b424-4d014cdb8606 service nova] Creating event network-vif-deleted:247bdc76-37cc-4751-82b6-e4aaca65e313 for instance 9f8480cf-4061-4c55-8118-a74951cf6142 on hv-cinder-85164 Aug 08 00:37:59.445044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-e4e2fd68-50fb-4b28-aed5-f0e25c12570d req-28865234-877c-40ea-b424-4d014cdb8606 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096870 Aug 08 00:37:59.445662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 326/653] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:00.019687 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:00.020370 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:00.026842 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:00.027339 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:00.027777 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:00.028464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:00.028916 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:00.029340 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:00.178555 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:00.186303 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-51d4a969-a561-4cd0-9d5d-17cc5cd85f92 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1366 microversion: 2.1 time: 0.170405 Aug 08 00:38:00.186867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 328/654] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:00 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:38:00.198413 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:00.199110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:00.206706 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:00.207340 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:00.207959 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:00.209057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:00.209705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:00.210230 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:00.244552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:00.245032 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:00.245468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:00.245940 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lazy-loading 'fault' on Instance uuid 9f8480cf-4061-4c55-8118-a74951cf6142 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:38:00.292212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:00.301670 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-80122599-0127-418e-9cc7-cec97b69502a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 200 len: 1311 microversion: 2.1 time: 0.107934 Aug 08 00:38:00.302572 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 327/655] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:00 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:00.604501 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-8b013532-2fb4-4026-ac5c-5f387469d725 req-b7c5760d-ef31-45bc-b68b-d7d5d16fe937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c80c22a-1596-4b59-a033-7c82163e2b00", "tag": "925b229f-7a24-4cd8-9a75-d6005c402efb"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:00.613750 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8b013532-2fb4-4026-ac5c-5f387469d725 req-b7c5760d-ef31-45bc-b68b-d7d5d16fe937 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:00.614230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8b013532-2fb4-4026-ac5c-5f387469d725 req-b7c5760d-ef31-45bc-b68b-d7d5d16fe937 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:00.614664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8b013532-2fb4-4026-ac5c-5f387469d725 req-b7c5760d-ef31-45bc-b68b-d7d5d16fe937 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:00.625806 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-8b013532-2fb4-4026-ac5c-5f387469d725 req-b7c5760d-ef31-45bc-b68b-d7d5d16fe937 service nova] Creating event network-changed:925b229f-7a24-4cd8-9a75-d6005c402efb for instance 1c80c22a-1596-4b59-a033-7c82163e2b00 on hv-cinder-85164 Aug 08 00:38:00.630699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-8b013532-2fb4-4026-ac5c-5f387469d725 req-b7c5760d-ef31-45bc-b68b-d7d5d16fe937 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086395 Aug 08 00:38:00.631322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 329/656] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:01.209814 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:01.212415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:01.214896 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:01.219996 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:01.220476 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:01.220909 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:01.221627 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:01.222104 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:01.222522 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:01.323897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:01.324689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 9f8480cf-4061-4c55-8118-a74951cf6142] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:01.331356 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:01.331945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:01.332457 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:01.333236 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:01.334020 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:01.334520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:01.350169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] HTTP exception thrown: Instance 9f8480cf-4061-4c55-8118-a74951cf6142 could not be found. Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Request method failure captured: Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 HTTP/1.1 Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FmiSdbrB2DQZbEo_7DUiSWc_4dae8wGG5xoFF5XZW8ovdJ5Pc-0c4-PyjQUjY4ASLkMp8v9RZbQw52NYnVCxcI5HiJA30AQUXRi0xuHJal7gwJJpJT0uN2V2ZaWbeHIZd479JeoVYQI2OaPhELhP0Lhs3-4ZUcVAzxMiEhitsXyfTo Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:38:01.352276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: c0aa06eea99f4011ab85ec51b0e60f2c Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 9f8480cf-4061-4c55-8118-a74951cf6142 could not be found. Aug 08 00:38:01.353629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '9f8480cf-4061-4c55-8118-a74951cf6142'} Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8480cf-4061-4c55-8118-a74951cf6142 could not be found. Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:38:01.354404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8480cf-4061-4c55-8118-a74951cf6142 could not be found. Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8480cf-4061-4c55-8118-a74951cf6142 could not be found. Aug 08 00:38:01.355692 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:01.356889 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Returning 404 to user: Instance 9f8480cf-4061-4c55-8118-a74951cf6142 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:38:01.356979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:01.357083 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-023ab0db-60fa-4b21-bad6-52fc57c4e89a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142" status: 404 len: 111 microversion: 2.1 time: 0.034399 Aug 08 00:38:01.357083 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 330/657] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:01 2022] GET /compute/v2.1/servers/9f8480cf-4061-4c55-8118-a74951cf6142 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:38:01.361480 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8e7faf07-3e63-4599-88dd-b9ccb77149b1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1366 microversion: 2.1 time: 0.156044 Aug 08 00:38:01.361959 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:01.362586 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:01.369645 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:01.370132 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:01.370573 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:01.371297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:01.371755 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:01.372494 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:01.375255 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 328/658] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:01 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:01.400211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:38:01.683212 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-50472b0a-bc31-455c-8df7-8e1eaa34c58e tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 204 len: 0 microversion: 2.1 time: 0.324937 Aug 08 00:38:01.683817 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 331/659] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:38:01 2022] DELETE /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:38:01.692411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:01.695887 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:01.698985 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:01.699493 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:01.699929 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:01.700607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:01.701052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:01.701468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:01.832579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:01.840238 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1498c55e-8d9e-4629-a6fd-6ad8906afc62 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.151590 Aug 08 00:38:01.840834 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 329/660] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:01 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:02.382519 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:02.383144 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:02.390481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:02.397092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:02.397092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:02.397092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:02.397092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:02.397589 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:02.503578 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:02.504108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:02.510453 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:02.510938 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:02.511440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:02.512145 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:02.512601 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:02.513026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:02.528152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:02.536205 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e9e2f0f0-3430-447c-82dc-39bfd454ae36 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1366 microversion: 2.1 time: 0.157984 Aug 08 00:38:02.536784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 332/661] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:02 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:02.593581 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lazy-loading 'services' on Instance uuid 533ddba6-cc0a-4ab2-8454-0b334257c1f4 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:38:02.794401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7f3c000b-eb47-4ed6-98f9-0724b51b88f4 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "DELETE /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4/os-volume_attachments/5001fa15-133c-47ff-9473-237f8cdfa67c" status: 202 len: 0 microversion: 2.1 time: 0.295577 Aug 08 00:38:02.794996 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 330/662] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:38:02 2022] DELETE /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4/os-volume_attachments/5001fa15-133c-47ff-9473-237f8cdfa67c => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 00:38:02.861806 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:02.862560 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:02.868986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:02.869470 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:02.869904 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:02.870603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:02.871056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:02.871514 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:02.876617 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:03.001902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:03.009374 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-67fa0754-093d-4f6e-9189-49944f51a163 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.152405 Aug 08 00:38:03.009938 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 333/663] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:02 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:03.557506 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:03.558316 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:03.564704 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:03.565183 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:03.565720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:03.566413 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:03.566863 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:03.567390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:03.699898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:03.708396 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5d51814c-3567-4635-9034-04769d621ca3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1366 microversion: 2.1 time: 0.156179 Aug 08 00:38:03.709220 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 331/664] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:03 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:04.030010 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:04.030652 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:04.037048 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:04.037535 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:04.037969 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:04.038660 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:04.039114 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:04.039565 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:04.166461 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:04.174134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-121d5e4a-3a2a-4270-83a6-bd695b530703 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.148217 Aug 08 00:38:04.174758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 334/665] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:04 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:04.436711 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-4b8bdc2c-c372-4686-a696-7f9321669d44 req-447ebc64-8f2c-4287-835d-28158dfd2405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c80c22a-1596-4b59-a033-7c82163e2b00", "name": "network-vif-plugged", "status": "completed", "tag": "925b229f-7a24-4cd8-9a75-d6005c402efb"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:04.445996 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-4b8bdc2c-c372-4686-a696-7f9321669d44 req-447ebc64-8f2c-4287-835d-28158dfd2405 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:04.446470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-4b8bdc2c-c372-4686-a696-7f9321669d44 req-447ebc64-8f2c-4287-835d-28158dfd2405 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:04.446893 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-4b8bdc2c-c372-4686-a696-7f9321669d44 req-447ebc64-8f2c-4287-835d-28158dfd2405 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:04.458185 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-4b8bdc2c-c372-4686-a696-7f9321669d44 req-447ebc64-8f2c-4287-835d-28158dfd2405 service nova] Creating event network-vif-plugged:925b229f-7a24-4cd8-9a75-d6005c402efb for instance 1c80c22a-1596-4b59-a033-7c82163e2b00 on hv-cinder-85164 Aug 08 00:38:04.463187 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-4b8bdc2c-c372-4686-a696-7f9321669d44 req-447ebc64-8f2c-4287-835d-28158dfd2405 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030325 Aug 08 00:38:04.463798 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 332/666] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:04.729227 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:04.729771 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:04.735883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:04.736363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:04.736802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:04.737485 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:04.737938 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:04.738365 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:04.867913 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:04.875788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f80eefe0-bc24-4a45-946d-a6550180ed20 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1366 microversion: 2.1 time: 0.150603 Aug 08 00:38:04.876348 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 335/667] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:04 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:05.196711 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:05.197410 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:05.203728 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:05.204210 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:05.204646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:05.205337 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:05.205791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:05.206221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:05.334640 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:05.342757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2a258993-8dcf-463d-91ce-99041f422ea9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.150627 Aug 08 00:38:05.343506 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 333/668] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:05 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:05.896271 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:05.896866 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:05.903336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:05.903817 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:05.904283 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:05.905060 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:05.905603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:05.906025 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:06.037069 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:06.044421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-11635395-b91a-4473-82e9-91f5806c1406 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1366 microversion: 2.1 time: 0.152105 Aug 08 00:38:06.044999 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 336/669] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:05 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:06.363722 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:06.364327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:06.370771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:06.376427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:06.376427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:06.376427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:06.376427 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:06.376823 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:06.508596 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:06.516568 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-570f1d34-e4da-455d-b450-d56c57e1c722 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1522 microversion: 2.1 time: 0.156637 Aug 08 00:38:06.517156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 334/670] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:06 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:06.948726 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-504998b9-c894-4e57-b18e-c970c1637957 req-76d0fd1e-5090-407d-a3bd-885f1d14cd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8968cf66-c321-4187-8166-47cdc6cc701e", "name": "network-vif-deleted", "tag": "04d4459b-df65-4f20-b895-eaa736bf1d79"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:06.959336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-504998b9-c894-4e57-b18e-c970c1637957 req-76d0fd1e-5090-407d-a3bd-885f1d14cd74 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:06.959816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-504998b9-c894-4e57-b18e-c970c1637957 req-76d0fd1e-5090-407d-a3bd-885f1d14cd74 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:06.960241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-504998b9-c894-4e57-b18e-c970c1637957 req-76d0fd1e-5090-407d-a3bd-885f1d14cd74 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:06.970861 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-504998b9-c894-4e57-b18e-c970c1637957 req-76d0fd1e-5090-407d-a3bd-885f1d14cd74 service nova] Creating event network-vif-deleted:04d4459b-df65-4f20-b895-eaa736bf1d79 for instance 8968cf66-c321-4187-8166-47cdc6cc701e on hv-cinder-85164 Aug 08 00:38:06.976240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-504998b9-c894-4e57-b18e-c970c1637957 req-76d0fd1e-5090-407d-a3bd-885f1d14cd74 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031081 Aug 08 00:38:06.976813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 337/671] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:07.066200 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:07.066803 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:07.073034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:07.073429 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:07.082388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:07.082388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:07.082388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:07.082388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:07.094611 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:07.095212 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:07.102132 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:07.104254 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:07.104254 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:07.104254 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:07.104254 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:07.104881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:07.134723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:38:07.234980 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:07.252162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ff2a8192-0164-4c9c-ac94-904b2ef8d40c tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1366 microversion: 2.1 time: 0.189634 Aug 08 00:38:07.253500 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 335/672] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:07 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:07.420061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-843234f4-9b4a-4a6c-bde7-70ebd6b96d4f tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "DELETE /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 204 len: 0 microversion: 2.1 time: 0.330086 Aug 08 00:38:07.420592 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 338/673] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:38:07 2022] DELETE /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 00:38:07.428773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:07.433063 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:07.436038 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:07.436778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:07.437273 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:07.437981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:07.438440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:07.438951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:07.538671 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:07.539406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:07.545774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:07.546266 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:07.546707 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:07.547444 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:07.547919 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:07.548324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:07.569959 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:07.578123 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e92d479a-42c1-4549-b88e-bd7263c87cac tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1514 microversion: 2.1 time: 0.153168 Aug 08 00:38:07.578708 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 336/674] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:07 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:07.579063 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:07.579584 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:07.580022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:07.580469 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lazy-loading 'fault' on Instance uuid 8968cf66-c321-4187-8166-47cdc6cc701e {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:38:07.621554 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:07.629028 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2322bda2-8b27-4620-b40e-114949900e2a tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1311 microversion: 2.1 time: 0.094664 Aug 08 00:38:07.629606 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 339/675] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:07 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:38:08.274189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:08.274792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:08.280871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:08.281341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:08.281771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:08.282458 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:08.282899 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:08.283354 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:08.409923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:08.417448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-779fbde5-9819-46bc-ab91-6d0776993fcb tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1557 microversion: 2.1 time: 0.147261 Aug 08 00:38:08.418042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 337/676] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:08 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:08.438976 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9a27348b-410d-41e0-b7bd-3c5a9a54d4ac tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:08.439531 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9a27348b-410d-41e0-b7bd-3c5a9a54d4ac tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:08.445906 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9a27348b-410d-41e0-b7bd-3c5a9a54d4ac tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:08.446391 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9a27348b-410d-41e0-b7bd-3c5a9a54d4ac tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:08.446833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9a27348b-410d-41e0-b7bd-3c5a9a54d4ac tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:08.447566 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9a27348b-410d-41e0-b7bd-3c5a9a54d4ac tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:08.448027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9a27348b-410d-41e0-b7bd-3c5a9a54d4ac tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:08.448462 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9a27348b-410d-41e0-b7bd-3c5a9a54d4ac tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:08.524403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9a27348b-410d-41e0-b7bd-3c5a9a54d4ac tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090158 Aug 08 00:38:08.524951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 340/677] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 00:38:08 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:08.598976 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:08.599612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:08.605901 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:08.606382 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:08.606810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:08.607531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:08.608551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:08.609086 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:08.624274 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:08.650536 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:08.651269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:08.659985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:08.660542 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:08.661041 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:08.661803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:08.662322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:08.662809 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:08.695599 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:08.696088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:08.696523 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:08.697040 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lazy-loading 'fault' on Instance uuid 8968cf66-c321-4187-8166-47cdc6cc701e {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:38:08.743472 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:08.751448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-56561c4b-2fdd-4c3c-bc19-c6c78b4c99e3 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1311 microversion: 2.1 time: 0.105293 Aug 08 00:38:08.755177 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 341/678] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:08 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:38:08.858174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:08.865662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-71f946a2-e26b-44e3-b2bf-0c2be540919e tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1514 microversion: 2.1 time: 0.270503 Aug 08 00:38:08.866227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 338/679] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:08 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:09.594111 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-87135f6a-d833-424b-8565-ad2f3ec6eca6 req-c1421008-ee2c-4e0c-863d-e05707153ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c80c22a-1596-4b59-a033-7c82163e2b00", "tag": "925b229f-7a24-4cd8-9a75-d6005c402efb"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:09.604121 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-87135f6a-d833-424b-8565-ad2f3ec6eca6 req-c1421008-ee2c-4e0c-863d-e05707153ac3 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:09.604602 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-87135f6a-d833-424b-8565-ad2f3ec6eca6 req-c1421008-ee2c-4e0c-863d-e05707153ac3 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:09.605037 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-87135f6a-d833-424b-8565-ad2f3ec6eca6 req-c1421008-ee2c-4e0c-863d-e05707153ac3 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:09.616472 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-87135f6a-d833-424b-8565-ad2f3ec6eca6 req-c1421008-ee2c-4e0c-863d-e05707153ac3 service nova] Creating event network-changed:925b229f-7a24-4cd8-9a75-d6005c402efb for instance 1c80c22a-1596-4b59-a033-7c82163e2b00 on hv-cinder-85164 Aug 08 00:38:09.621425 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-87135f6a-d833-424b-8565-ad2f3ec6eca6 req-c1421008-ee2c-4e0c-863d-e05707153ac3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031838 Aug 08 00:38:09.622023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 342/680] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:09.772241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:09.772852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:09.780411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:09.780912 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:09.781347 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:09.782045 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:09.782500 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:09.782925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:09.814745 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:09.815252 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:09.815691 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:09.816133 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lazy-loading 'fault' on Instance uuid 8968cf66-c321-4187-8166-47cdc6cc701e {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:38:09.867282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0aa06eea99f4011ab85ec51b0e60f2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd235f1f9f44df4b2e3dbd0c05b3a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:09.875491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-822543b5-435d-425e-bedb-a5fed5684ba9 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 200 len: 1311 microversion: 2.1 time: 0.107114 Aug 08 00:38:09.876073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 339/681] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:09 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:09.886461 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:09.887151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:09.893902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:09.894498 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:09.894932 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:09.895756 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:09.896235 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:09.896658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:10.126223 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:10.136576 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5d5de7b3-12e0-4fec-818a-f6e1b865516c tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1514 microversion: 2.1 time: 0.253669 Aug 08 00:38:10.153147 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 343/682] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:09 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:10.896973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:10.897597 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] [instance: 8968cf66-c321-4187-8166-47cdc6cc701e] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:10.905005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:10.905586 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:10.906033 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:10.906757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:10.907217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:10.907925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:10.922925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] HTTP exception thrown: Instance 8968cf66-c321-4187-8166-47cdc6cc701e could not be found. Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Request method failure captured: Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e HTTP/1.1 Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FmiSdbrB2DQZbEo_7DUiSWc_4dae8wGG5xoFF5XZW8ovdJ5Pc-0c4-PyjQUjY4ASLkMp8v9RZbQw52NYnVCxcI5HiJA30AQUXRi0xuHJal7gwJJpJT0uN2V2ZaWbeHIZd479JeoVYQI2OaPhELhP0Lhs3-4ZUcVAzxMiEhitsXyfTo Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:38:10.924646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9bd235f1f9f44df4b2e3dbd0c05b3a83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 9bd235f1f9f44df4b2e3dbd0c05b3a83 Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-657776836 Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: c0aa06eea99f4011ab85ec51b0e60f2c Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-ServerRescueNegativeTestJSON-657776836-project Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 8968cf66-c321-4187-8166-47cdc6cc701e could not be found. Aug 08 00:38:10.926223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '8968cf66-c321-4187-8166-47cdc6cc701e'} Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8968cf66-c321-4187-8166-47cdc6cc701e could not be found. Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:38:10.927839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8968cf66-c321-4187-8166-47cdc6cc701e could not be found. Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8968cf66-c321-4187-8166-47cdc6cc701e could not be found. Aug 08 00:38:10.929401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:10.930725 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] Returning 404 to user: Instance 8968cf66-c321-4187-8166-47cdc6cc701e could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:38:10.930725 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4ad080fd-bc0e-439b-bce6-9d322b645306 tempest-ServerRescueNegativeTestJSON-657776836 tempest-ServerRescueNegativeTestJSON-657776836-project] 10.222.0.15 "GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e" status: 404 len: 111 microversion: 2.1 time: 0.033101 Aug 08 00:38:10.930725 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 340/683] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:10 2022] GET /compute/v2.1/servers/8968cf66-c321-4187-8166-47cdc6cc701e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:38:10.943341 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-8dc2b403-3b67-418e-baa7-1c015a73382a req-fb51469a-b9f4-4912-ba76-df4732e4def2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533ddba6-cc0a-4ab2-8454-0b334257c1f4", "name": "network-vif-deleted", "tag": "430ffc0d-3a6e-4567-a0ef-49524240e6c5"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:10.954483 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8dc2b403-3b67-418e-baa7-1c015a73382a req-fb51469a-b9f4-4912-ba76-df4732e4def2 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:10.955030 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8dc2b403-3b67-418e-baa7-1c015a73382a req-fb51469a-b9f4-4912-ba76-df4732e4def2 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:10.955738 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8dc2b403-3b67-418e-baa7-1c015a73382a req-fb51469a-b9f4-4912-ba76-df4732e4def2 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:10.967649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-8dc2b403-3b67-418e-baa7-1c015a73382a req-fb51469a-b9f4-4912-ba76-df4732e4def2 service nova] Creating event network-vif-deleted:430ffc0d-3a6e-4567-a0ef-49524240e6c5 for instance 533ddba6-cc0a-4ab2-8454-0b334257c1f4 on hv-cinder-85164 Aug 08 00:38:10.972746 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-8dc2b403-3b67-418e-baa7-1c015a73382a req-fb51469a-b9f4-4912-ba76-df4732e4def2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033851 Aug 08 00:38:10.973398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 344/684] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:11.158402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:11.159052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:11.168637 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:11.169125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:11.169607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:11.170885 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:11.171374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:11.171794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:11.247843 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f950ecd21b5a4612bff847604ad8efdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8f2a58683be4aa486cebdf7aa8e0d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:11.257434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6556e993-c7d8-464f-815f-af43da09192a tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 200 len: 1304 microversion: 2.1 time: 0.103114 Aug 08 00:38:11.258275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 341/685] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:11 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:12.279018 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:12.279833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] [instance: 533ddba6-cc0a-4ab2-8454-0b334257c1f4] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:12.285680 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:12.286149 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:12.286578 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:12.287291 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:12.287740 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:12.288159 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:12.301289 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] HTTP exception thrown: Instance 533ddba6-cc0a-4ab2-8454-0b334257c1f4 could not be found. Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Request method failure captured: Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 HTTP/1.1 Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FpjiylEYFDzJSNBmH3YGkhqIiF-cpxGN7QLu5wo-dBZeHHF3Yhgl5Eu6pARIWt3cRpcKIfnr561rvzOHUoDK254pJ4_KFmKXxzNoQMwjpGgVoQ5ZSTWQvqSOEhyTTkxeNYNBR5YGSRZ3aOOHzzxVZD0oZBID72U6BIn79fu-gFL4Ew Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: b8f2a58683be4aa486cebdf7aa8e0d83 Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1144645517 Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:38:12.302872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b8f2a58683be4aa486cebdf7aa8e0d83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f2a58683be4aa486cebdf7aa8e0d83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b8f2a58683be4aa486cebdf7aa8e0d83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b8f2a58683be4aa486cebdf7aa8e0d83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-VolumesSnapshotTestJSON-1144645517 Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: b8f2a58683be4aa486cebdf7aa8e0d83 Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1144645517 Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-VolumesSnapshotTestJSON-1144645517-project Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: f950ecd21b5a4612bff847604ad8efdd Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-VolumesSnapshotTestJSON-1144645517-project Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 533ddba6-cc0a-4ab2-8454-0b334257c1f4 could not be found. Aug 08 00:38:12.312052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '533ddba6-cc0a-4ab2-8454-0b334257c1f4'} Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533ddba6-cc0a-4ab2-8454-0b334257c1f4 could not be found. Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:38:12.313086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533ddba6-cc0a-4ab2-8454-0b334257c1f4 could not be found. Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533ddba6-cc0a-4ab2-8454-0b334257c1f4 could not be found. Aug 08 00:38:12.314491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:12.315648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] Returning 404 to user: Instance 533ddba6-cc0a-4ab2-8454-0b334257c1f4 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:38:12.315648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-16d63a1e-34c7-417e-a7f8-97835bd257f1 tempest-VolumesSnapshotTestJSON-1144645517 tempest-VolumesSnapshotTestJSON-1144645517-project] 10.222.0.15 "GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4" status: 404 len: 111 microversion: 2.1 time: 0.030059 Aug 08 00:38:12.315648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 345/686] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:12 2022] GET /compute/v2.1/servers/533ddba6-cc0a-4ab2-8454-0b334257c1f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:38:17.439936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0283fb2b-e641-46dc-9c2d-a52161435c04 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:17.440434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0283fb2b-e641-46dc-9c2d-a52161435c04 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:17.446313 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0283fb2b-e641-46dc-9c2d-a52161435c04 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:17.446792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0283fb2b-e641-46dc-9c2d-a52161435c04 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:17.447245 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0283fb2b-e641-46dc-9c2d-a52161435c04 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:17.447964 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0283fb2b-e641-46dc-9c2d-a52161435c04 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:17.448418 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0283fb2b-e641-46dc-9c2d-a52161435c04 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:17.448836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0283fb2b-e641-46dc-9c2d-a52161435c04 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:17.477334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0283fb2b-e641-46dc-9c2d-a52161435c04 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/ips" status: 200 len: 153 microversion: 2.20 time: 0.216921 Aug 08 00:38:17.477900 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 342/687] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Aug 8 00:38:17 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/ips => generated 153 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 00:38:17.604614 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-900758607"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:17.605187 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:17.611669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:17.612150 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:17.612581 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:17.613276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:17.613728 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:17.614153 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:17.754140 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.network.security_group_api [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Removing security group c227dc7a-bed5-43d0-a843-be28d0e38ab6 from port 52a4e9c0-250f-456a-959b-dc428c3b9d82 Aug 08 00:38:18.154903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-72472ce2-7877-4e7a-b72b-7058daecf98c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "POST /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/action" status: 202 len: 0 microversion: 2.1 time: 0.554070 Aug 08 00:38:18.155985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 346/688] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:38:17 2022] POST /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:38:18.173539 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-bd759330-41b6-456d-9b07-c7b6bfbaaa53 req-f2696f13-a353-4892-9493-8201ac50cb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7", "tag": "52a4e9c0-250f-456a-959b-dc428c3b9d82"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:18.178537 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-bd759330-41b6-456d-9b07-c7b6bfbaaa53 req-f2696f13-a353-4892-9493-8201ac50cb5b service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:18.179346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-bd759330-41b6-456d-9b07-c7b6bfbaaa53 req-f2696f13-a353-4892-9493-8201ac50cb5b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:18.180001 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-bd759330-41b6-456d-9b07-c7b6bfbaaa53 req-f2696f13-a353-4892-9493-8201ac50cb5b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:18.196151 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-bd759330-41b6-456d-9b07-c7b6bfbaaa53 req-f2696f13-a353-4892-9493-8201ac50cb5b service nova] Creating event network-changed:52a4e9c0-250f-456a-959b-dc428c3b9d82 for instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 on hv-cinder-85164 Aug 08 00:38:18.202622 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-bd759330-41b6-456d-9b07-c7b6bfbaaa53 req-f2696f13-a353-4892-9493-8201ac50cb5b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039082 Aug 08 00:38:18.204812 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 343/689] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:19.618960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-6dfaa044-ec11-4047-9bad-c8647bd27451 req-5ee25196-452f-4283-ac38-2af03df0193a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7", "tag": "52a4e9c0-250f-456a-959b-dc428c3b9d82"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:19.621025 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:19.621625 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:19.629708 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:19.630327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:19.631000 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:19.631981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:19.632695 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:19.633338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:19.637267 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-6dfaa044-ec11-4047-9bad-c8647bd27451 req-5ee25196-452f-4283-ac38-2af03df0193a service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:19.637811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-6dfaa044-ec11-4047-9bad-c8647bd27451 req-5ee25196-452f-4283-ac38-2af03df0193a service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:19.640701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-6dfaa044-ec11-4047-9bad-c8647bd27451 req-5ee25196-452f-4283-ac38-2af03df0193a service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:19.657813 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-6dfaa044-ec11-4047-9bad-c8647bd27451 req-5ee25196-452f-4283-ac38-2af03df0193a service nova] Creating event network-changed:52a4e9c0-250f-456a-959b-dc428c3b9d82 for instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 on hv-cinder-85164 Aug 08 00:38:19.664100 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-6dfaa044-ec11-4047-9bad-c8647bd27451 req-5ee25196-452f-4283-ac38-2af03df0193a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049748 Aug 08 00:38:19.665531 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 344/690] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:19.672030 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:19.672841 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:19.689160 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:19.689652 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:19.690085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:19.690789 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:19.691276 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:19.691731 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:19.725090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lazy-loading 'flavor' on Instance uuid 0cf02d3a-b426-4135-a94a-9048d7515184 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:38:19.742922 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lazy-loading 'services' on Instance uuid 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:38:20.032087 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-490b4d2c-c908-4ca0-a05a-db6be3a29905 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "DELETE /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments/8be0a76d-2369-4804-b468-c5a292a781ef" status: 202 len: 0 microversion: 2.1 time: 0.418793 Aug 08 00:38:20.036028 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 347/691] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:38:19 2022] DELETE /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments/8be0a76d-2369-4804-b468-c5a292a781ef => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:38:20.042566 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7ed36b54-1e73-45b0-a7b4-b2e415b1cef6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:20.045178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-7ed36b54-1e73-45b0-a7b4-b2e415b1cef6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:20.052373 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ed36b54-1e73-45b0-a7b4-b2e415b1cef6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:20.053201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ed36b54-1e73-45b0-a7b4-b2e415b1cef6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:20.053898 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ed36b54-1e73-45b0-a7b4-b2e415b1cef6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:20.054826 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ed36b54-1e73-45b0-a7b4-b2e415b1cef6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:20.055500 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ed36b54-1e73-45b0-a7b4-b2e415b1cef6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:20.056248 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7ed36b54-1e73-45b0-a7b4-b2e415b1cef6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:20.088888 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-7ed36b54-1e73-45b0-a7b4-b2e415b1cef6 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050763 Aug 08 00:38:20.090055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 348/692] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:38:20 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:20.331002 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-392dc824-b46d-47f5-be8a-e71f14b4425f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/action" status: 202 len: 0 microversion: 2.20 time: 0.663830 Aug 08 00:38:20.331646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 345/693] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 8 00:38:19 2022] POST /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:38:20.340500 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:20.341214 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:20.347997 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:20.348680 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:20.349489 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:20.350341 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:20.352434 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:20.352434 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:20.535799 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:20.554835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:20.556960 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:20.558928 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-47540eb0-0542-4ddf-8261-23bf16490fa6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.222455 Aug 08 00:38:20.572433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 349/694] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:20 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:21.103875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6895f419-a631-45df-945b-d899da86133a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:21.106166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6895f419-a631-45df-945b-d899da86133a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:21.113970 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6895f419-a631-45df-945b-d899da86133a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:21.114461 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6895f419-a631-45df-945b-d899da86133a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:21.114901 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6895f419-a631-45df-945b-d899da86133a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:21.115624 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6895f419-a631-45df-945b-d899da86133a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:21.116088 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6895f419-a631-45df-945b-d899da86133a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:21.116516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6895f419-a631-45df-945b-d899da86133a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:21.145760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6895f419-a631-45df-945b-d899da86133a tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046726 Aug 08 00:38:21.146323 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 346/695] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:38:21 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:21.584874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:21.585364 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:21.591915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:21.592404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:21.592835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:21.594268 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:21.594722 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:21.595145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:21.599522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:21.731119 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:21.744086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:21.744086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:21.746308 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ccc4fca9-f345-4056-b8f5-973f4eae10a3 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.165782 Aug 08 00:38:21.746880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 350/696] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:21 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:22.158678 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ec58c2ca-5165-44f1-bb38-70e12798910c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:22.160824 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ec58c2ca-5165-44f1-bb38-70e12798910c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:22.167122 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ec58c2ca-5165-44f1-bb38-70e12798910c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:22.167635 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ec58c2ca-5165-44f1-bb38-70e12798910c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:22.168077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ec58c2ca-5165-44f1-bb38-70e12798910c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:22.168778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ec58c2ca-5165-44f1-bb38-70e12798910c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:22.169231 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ec58c2ca-5165-44f1-bb38-70e12798910c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:22.169655 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ec58c2ca-5165-44f1-bb38-70e12798910c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:22.198716 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ec58c2ca-5165-44f1-bb38-70e12798910c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044616 Aug 08 00:38:22.199217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 347/697] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:38:22 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 00:38:22.209933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:22.217154 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:22.217154 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:22.217368 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:22.217772 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:22.219235 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:22.219817 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:22.220230 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:22.314574 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] HTTP exception thrown: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 is not attached to volume 8be0a76d-2369-4804-b468-c5a292a781ef Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Request method failure captured: Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: DELETE /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments/8be0a76d-2369-4804-b468-c5a292a781ef HTTP/1.1 Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FooWYhh3NDAy3fH5F6S97EY37Tra8t_q7mfpC91vaxlVWJkI1GeQIdcITiVF2JqqGCrQXavdSrn2lXmuL7nn9sctocGRd9hSOs13lFLFVXUhzWEwOf5cFn0sRusXSnNPPoadA0HhHHwa13RfhkORf1gml0mQtugK2OnM0NuxtbEQPc Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: fc3040045262415cb0fcb9525ba437bc Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-TestMinimumBasicScenario-1356500782 Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:38:22.317393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fc3040045262415cb0fcb9525ba437bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fc3040045262415cb0fcb9525ba437bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fc3040045262415cb0fcb9525ba437bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fc3040045262415cb0fcb9525ba437bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-TestMinimumBasicScenario-1356500782 Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: fc3040045262415cb0fcb9525ba437bc Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1356500782 Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-TestMinimumBasicScenario-1356500782-project Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 41fecf50555a4effb8aca217296bbad6 Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-TestMinimumBasicScenario-1356500782-project Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:38:22.319050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 is not attached to volume 8be0a76d-2369-4804-b468-c5a292a781ef Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'server_id': '19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7', 'id': '8be0a76d-2369-4804-b468-c5a292a781ef'} Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8be0a76d-2369-4804-b468-c5a292a781ef. Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:38:22.319992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 is not attached to volume 8be0a76d-2369-4804-b468-c5a292a781ef Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 is not attached to volume 8be0a76d-2369-4804-b468-c5a292a781ef Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:38:22.322082 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Returning 404 to user: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 is not attached to volume 8be0a76d-2369-4804-b468-c5a292a781ef {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:38:22.323628 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-09b79e30-080b-4ea2-bea1-e3a4c0ed4c69 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "DELETE /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments/8be0a76d-2369-4804-b468-c5a292a781ef" status: 404 len: 154 microversion: 2.1 time: 0.113300 Aug 08 00:38:22.323628 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 351/698] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:38:22 2022] DELETE /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7/os-volume_attachments/8be0a76d-2369-4804-b468-c5a292a781ef => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:38:22.772852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:22.773454 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:22.782441 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:22.782940 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:22.783419 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:22.784130 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:22.784590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:22.785019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:22.917781 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:22.926510 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:22.928022 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:22.929166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-557e9849-fd46-43cc-b753-b5c014e11ae2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.160283 Aug 08 00:38:22.929730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 348/699] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:22 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:23.631041 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:23.631629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:23.633940 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:23.638862 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:23.639369 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:23.639815 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:23.641277 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:23.641751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:23.642169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:23.673558 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:38:23.956025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:23.956628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:23.963868 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:23.964897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:23.965518 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:23.966397 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:23.966848 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:23.967287 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:24.069521 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3e89ea3b-6708-4e5a-8d79-8231217eb1ef tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "DELETE /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 204 len: 0 microversion: 2.1 time: 0.442080 Aug 08 00:38:24.070108 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 352/700] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:38:23 2022] DELETE /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:38:24.085626 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:24.086930 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:24.096031 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:24.096518 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:24.097310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:24.100273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:24.100273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:24.100273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:24.103562 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:24.112129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:24.113619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:24.114780 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1174e464-20c1-401d-b77b-ffc9fe3ba2d7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.163167 Aug 08 00:38:24.115358 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 349/701] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:23 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:24.235186 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:24.242883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-81f04dea-c02f-4b8d-bb3f-55bceda0e57c tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1554 microversion: 2.1 time: 0.167554 Aug 08 00:38:24.243476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 353/702] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:24 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:38:25.137934 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:25.138632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:25.145129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:25.145607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:25.146036 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:25.146722 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:25.147167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:25.150736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:25.264371 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:25.264985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:25.271916 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:25.272699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:25.273214 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:25.273991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:25.274617 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:25.275051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:25.292739 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:25.300851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:25.302551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:25.304045 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0e9a9a22-bb71-44e3-bf3a-7c32c723c316 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.170034 Aug 08 00:38:25.304601 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 350/703] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:25 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:25.412603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:25.420072 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-53ff872c-e773-4163-ab25-872e383a3eba tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1554 microversion: 2.1 time: 0.159412 Aug 08 00:38:25.420632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 354/704] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:25 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:38:26.327628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:26.328234 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:26.335929 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:26.341097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:26.341097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:26.341097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:26.341097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:26.341464 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:26.442047 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:26.442759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:26.449610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:26.450095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:26.450532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:26.451255 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:26.451706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:26.452130 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:26.474670 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:26.482847 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:26.484393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:26.485610 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d45d009c-0f28-4eee-bfe2-981f97118c57 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.162417 Aug 08 00:38:26.486722 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 351/705] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:26 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:26.583441 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:26.591168 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5315843d-35a9-4ff4-a712-dc7546314dd4 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1554 microversion: 2.1 time: 0.153645 Aug 08 00:38:26.593351 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 355/706] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:26 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:27.510035 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:27.510636 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:27.516649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:27.517125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:27.518379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:27.518833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:27.519303 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:27.519726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:27.612019 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:27.614119 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:27.627269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:27.627770 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:27.628225 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:27.628920 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:27.629372 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:27.629888 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:27.689741 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:27.698533 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:27.700304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:27.701462 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-aa6169e7-ccdb-4c78-8916-e65a30080104 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.195424 Aug 08 00:38:27.702004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 352/707] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:27 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:27.826629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:27.834935 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-638f6389-a71c-4d5f-bdc4-5ed87936fbcc tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1554 microversion: 2.1 time: 0.226836 Aug 08 00:38:27.835536 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 356/708] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:27 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:38:28.011517 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-1c21c91b-2a94-4d73-8fdf-b28334aa0523 req-ed2c1489-0037-461e-87e2-f105442ecddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7", "name": "network-vif-deleted", "tag": "52a4e9c0-250f-456a-959b-dc428c3b9d82"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:28.022247 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-1c21c91b-2a94-4d73-8fdf-b28334aa0523 req-ed2c1489-0037-461e-87e2-f105442ecddf service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:28.022923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-1c21c91b-2a94-4d73-8fdf-b28334aa0523 req-ed2c1489-0037-461e-87e2-f105442ecddf service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:28.023549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-1c21c91b-2a94-4d73-8fdf-b28334aa0523 req-ed2c1489-0037-461e-87e2-f105442ecddf service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:28.037259 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-1c21c91b-2a94-4d73-8fdf-b28334aa0523 req-ed2c1489-0037-461e-87e2-f105442ecddf service nova] Creating event network-vif-deleted:52a4e9c0-250f-456a-959b-dc428c3b9d82 for instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 on hv-cinder-85164 Aug 08 00:38:28.042600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-1c21c91b-2a94-4d73-8fdf-b28334aa0523 req-ed2c1489-0037-461e-87e2-f105442ecddf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034721 Aug 08 00:38:28.043573 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 353/709] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:28.725066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:28.725682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:28.731664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:28.732150 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:28.732585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:28.733292 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:28.733747 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:28.734321 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:28.857951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:28.858728 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:28.866457 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:28.869968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:28.869968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:28.869968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:28.869968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:28.870478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:28.871342 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:28.880756 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:28.882421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:28.883629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-45f55713-e958-48f8-b6ff-703dd78ab108 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.163673 Aug 08 00:38:28.884379 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 357/710] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:28 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:28.906567 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:28.907041 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:28.907502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:28.907986 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lazy-loading 'fault' on Instance uuid 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:38:28.950556 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41fecf50555a4effb8aca217296bbad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc3040045262415cb0fcb9525ba437bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:28.960917 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-84e8ec2d-8d2a-4402-9cd8-7432483e0f2f tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 200 len: 1348 microversion: 2.1 time: 0.105067 Aug 08 00:38:28.960917 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 354/711] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:28 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:29.910305 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:29.917253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:29.917253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:29.917744 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:29.918189 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:29.918889 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:29.919370 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:29.919796 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:29.980684 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:29.981292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] [instance: 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:29.988172 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:29.993852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:29.993852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:29.993852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:29.993852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:29.994211 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:30.005110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] HTTP exception thrown: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 could not be found. Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Request method failure captured: Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 HTTP/1.1 Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FooWYhh3NDAy3fH5F6S97EY37Tra8t_q7mfpC91vaxlVWJkI1GeQIdcITiVF2JqqGCrQXavdSrn2lXmuL7nn9sctocGRd9hSOs13lFLFVXUhzWEwOf5cFn0sRusXSnNPPoadA0HhHHwa13RfhkORf1gml0mQtugK2OnM0NuxtbEQPc Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: fc3040045262415cb0fcb9525ba437bc Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-TestMinimumBasicScenario-1356500782 Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:38:30.006791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fc3040045262415cb0fcb9525ba437bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fc3040045262415cb0fcb9525ba437bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fc3040045262415cb0fcb9525ba437bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fc3040045262415cb0fcb9525ba437bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-TestMinimumBasicScenario-1356500782 Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: fc3040045262415cb0fcb9525ba437bc Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1356500782 Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-TestMinimumBasicScenario-1356500782-project Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 41fecf50555a4effb8aca217296bbad6 Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-TestMinimumBasicScenario-1356500782-project Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 could not be found. Aug 08 00:38:30.008306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7'} Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 could not be found. Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:38:30.009116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 could not be found. Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 could not be found. Aug 08 00:38:30.010474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:38:30.011767 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Returning 404 to user: Instance 19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:38:30.011767 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-56efd84b-fe6a-4072-b41f-2107760e3f0b tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7" status: 404 len: 111 microversion: 2.1 time: 0.031333 Aug 08 00:38:30.011767 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 355/712] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:29 2022] GET /compute/v2.1/servers/19fb56ea-f1ea-4d66-9b9b-a86c0fa7ebb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:38:30.016726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2ce123a7-0bc2-4632-8949-45a8cc52c5d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] Calling method '.version_select at 0x7fd1a1dcd820>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:30.072876 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:30.077953 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:30.079521 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:30.081393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2d5305bf-0aa3-4706-8d5b-8bc9b53e8adc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.175297 Aug 08 00:38:30.081950 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 358/713] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:29 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:30.094751 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2ce123a7-0bc2-4632-8949-45a8cc52c5d0 tempest-TestMinimumBasicScenario-1356500782 tempest-TestMinimumBasicScenario-1356500782-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-689850189" status: 202 len: 0 microversion: 2.1 time: 0.081618 Aug 08 00:38:30.095461 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 356/714] 10.222.0.15 () {58 vars in 1269 bytes} [Mon Aug 8 00:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-689850189 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 08 00:38:31.104809 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:31.105421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:31.111315 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:31.111806 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:31.112275 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:31.113016 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:31.113476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:31.113904 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:31.263713 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:31.272638 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:31.274172 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:31.275383 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bbb44a39-62bb-4ebd-99cf-af9324ac86c0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.174951 Aug 08 00:38:31.275959 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 359/715] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:31 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:32.300598 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:32.301365 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:32.308238 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:32.314402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:32.315175 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:32.315724 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:32.316556 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:32.317245 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:32.317680 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:32.323286 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:32.534984 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:32.543137 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:32.544758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:32.545923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-391030cf-26ca-47b0-bcfa-b152bcd028ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.250944 Aug 08 00:38:32.546523 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 357/716] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:32 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:33.570241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:33.572124 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:33.589127 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:33.589717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:33.590220 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:33.590998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:33.591815 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:33.592314 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:33.825599 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:33.834225 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:33.835742 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:33.836897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2a73021d-e414-47e2-87c4-be2fbb87545f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.271945 Aug 08 00:38:33.837456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 360/717] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:33 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:34.860504 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:34.861117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:34.868763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:34.869659 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:34.870325 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:34.871298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:34.872048 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:34.872687 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:35.119800 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:35.130020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:35.131967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:35.133328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-088c74e7-0dac-4186-bd35-9b8af44d022d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.277056 Aug 08 00:38:35.143246 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 358/718] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:34 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:36.157764 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:36.158434 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:36.165039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:36.165421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:36.165816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:36.166521 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:36.167090 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:36.167541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:36.423858 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:36.434079 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:36.435795 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:36.436955 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ccace796-abbe-416e-b1d6-ee31e1908625 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.283236 Aug 08 00:38:36.437713 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 361/719] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:36 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:37.464426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:37.465053 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:37.487910 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:37.487910 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:37.487910 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:37.487910 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:37.488278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:37.488278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:37.647256 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:37.657622 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:37.659193 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:37.660433 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c375a4d0-20da-41b1-a457-ba71c492572c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1745 microversion: 2.20 time: 0.204298 Aug 08 00:38:37.661047 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 359/720] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:37 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:38.684563 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:38.685824 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:38.710363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:38.710883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:38.711361 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:38.712107 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:38.712560 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:38.748922 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:39.089926 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:39.097993 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:39.099512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:39.100675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c7a83b14-d0b2-42b3-9a63-8b20170318e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1745 microversion: 2.20 time: 0.420335 Aug 08 00:38:39.104677 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 362/721] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:38 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1745 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:40.124830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:40.126204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:40.134706 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:40.135503 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:40.135943 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:40.136661 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:40.137144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:40.137572 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:40.501902 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:40.515849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:40.519891 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:40.532665 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-745797cd-0bd1-4744-94cc-9c2771e74a66 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.412727 Aug 08 00:38:40.533993 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 360/722] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:40 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:40.992843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-6a84cc9b-6496-4dc6-ad99-fb0070f25c53 req-c52d1533-eb14-4fbf-853e-ade8a09a02be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf02d3a-b426-4135-a94a-9048d7515184", "name": "network-vif-plugged", "status": "completed", "tag": "434deac6-5c7d-4020-9d69-11e8d0ac4767"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:41.002950 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-6a84cc9b-6496-4dc6-ad99-fb0070f25c53 req-c52d1533-eb14-4fbf-853e-ade8a09a02be service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:41.005336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-6a84cc9b-6496-4dc6-ad99-fb0070f25c53 req-c52d1533-eb14-4fbf-853e-ade8a09a02be service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:41.005336 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-6a84cc9b-6496-4dc6-ad99-fb0070f25c53 req-c52d1533-eb14-4fbf-853e-ade8a09a02be service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:41.022446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-6a84cc9b-6496-4dc6-ad99-fb0070f25c53 req-c52d1533-eb14-4fbf-853e-ade8a09a02be service nova] Creating event network-vif-plugged:434deac6-5c7d-4020-9d69-11e8d0ac4767 for instance 0cf02d3a-b426-4135-a94a-9048d7515184 on hv-cinder-85164 Aug 08 00:38:41.030047 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-6a84cc9b-6496-4dc6-ad99-fb0070f25c53 req-c52d1533-eb14-4fbf-853e-ade8a09a02be service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.507806 Aug 08 00:38:41.034204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 363/723] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:38:41.563860 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:41.564473 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:41.577463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:41.577958 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:41.578391 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:41.582516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:41.582930 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:41.583383 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:41.768631 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:41.779255 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:41.780928 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:41.782257 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-089668a8-02de-440a-9bc9-d6f51faaa543 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.222240 Aug 08 00:38:41.783525 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 361/724] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:41 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:42.814192 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:42.816212 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:42.825962 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:42.827574 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:42.828327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:42.829826 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:42.830455 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:42.832093 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:42.996899 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:43.007089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:43.009049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:43.010483 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-92bc6095-0179-4ab3-8f65-e43f06d1dd1f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.203846 Aug 08 00:38:43.011168 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 364/725] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:42 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:44.034059 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:44.034870 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:44.042204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:44.042768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:44.043455 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:44.044647 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:44.045326 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:44.045939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:44.201917 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:44.210766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:44.212282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:44.213648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3874ffa6-be0f-4296-ba92-dbc67e6a991f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.183494 Aug 08 00:38:44.214367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 362/726] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:44 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:45.239009 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:45.239641 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:45.246540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:45.247903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:45.248544 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:45.249505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:45.249953 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:45.250591 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:45.408673 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:45.413944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:45.419193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:45.420695 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:45.422078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f6943b2b-96eb-4e25-8f88-b70a022718cc tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.187902 Aug 08 00:38:45.422621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 365/727] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:45 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:46.452285 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:46.453070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:46.459812 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:46.460314 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:46.460711 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:46.461432 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:46.461880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:46.462319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:46.607322 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:46.616416 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:46.618069 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:46.619263 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-35b36873-74f4-4655-989c-8e410b64f302 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.171135 Aug 08 00:38:46.619911 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 363/728] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:46 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:47.261268 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:47.261812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:47.270728 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:47.271266 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:47.271893 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:47.272597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:47.273051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:47.273648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:47.302836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lazy-loading 'flavor' on Instance uuid 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:38:47.588670 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e683f48a-7623-45ba-92fa-346e4f72aa16 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "POST /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3/action" status: 202 len: 0 microversion: 2.1 time: 0.331007 Aug 08 00:38:47.592900 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 366/729] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:38:47 2022] POST /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:38:47.597884 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:47.599402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:47.621779 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:47.622514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:47.623153 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:47.624066 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:47.624678 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:47.625264 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:47.649710 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:47.650854 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:47.669043 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:47.669808 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:47.670406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:47.671313 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:47.671918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:47.672529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:47.809092 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:47.817050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fd58e4e5-8c62-48a1-8490-405cef975c62 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.222988 Aug 08 00:38:47.819209 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 364/730] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:47 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:38:47.855523 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:47.863732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:47.865440 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:47.866614 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-37da54ef-36a8-4940-9491-d140f900b95e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.222611 Aug 08 00:38:47.867177 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 367/731] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:47 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:48.840825 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:48.841594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:48.848654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:48.849853 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:48.850415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:48.851213 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:48.851759 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:48.852386 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:48.892279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:48.893701 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:48.903820 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:48.904745 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:48.905407 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:48.906397 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:48.907209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:48.908000 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:49.024951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:49.034387 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-96e7beb2-de10-4658-9010-880568832e13 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.197378 Aug 08 00:38:49.035366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 365/732] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:48 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:49.080589 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:49.090080 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:49.095193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:49.097014 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4b3f4e89-1644-4b97-916b-db1bb460c8e6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.209590 Aug 08 00:38:49.097904 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 368/733] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:48 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:50.056689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:50.057227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:50.063658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:50.064162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:50.064594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:50.065272 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:50.065716 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:50.066131 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:50.120451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:50.122086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:50.129768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:50.131217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:50.132001 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:50.133030 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:50.133713 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:50.134344 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:50.217992 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:50.226109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b291689b-e2b7-472c-9383-bc0ba5856ecc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.173253 Aug 08 00:38:50.229334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 366/734] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:50 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:50.309321 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:50.326058 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:50.327842 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:50.329293 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-09ec472a-f450-4971-ad87-150b47227aa2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.212886 Aug 08 00:38:50.330186 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 369/735] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:50 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:51.249635 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:51.250397 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:51.258959 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:51.259612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:51.260050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:51.260755 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:51.261214 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:51.261644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:51.355550 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:51.356162 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:51.362769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:51.363158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:51.363632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:51.365115 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:51.365115 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:51.365719 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:51.392366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:51.401770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fe0c3558-f63b-4c14-8030-193ac2bbad46 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.155818 Aug 08 00:38:51.402511 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 367/736] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:51 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:51.505878 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:51.514108 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:51.515626 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:51.516774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a1c25a91-f702-4edf-a978-c9cf2c92b538 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1740 microversion: 2.20 time: 0.165027 Aug 08 00:38:51.517332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 370/737] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:51 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:52.422898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:52.423681 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:52.430871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:52.431529 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:52.431960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:52.432654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:52.433102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:52.433521 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:52.539639 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:52.540390 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:52.546958 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:52.547505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:52.547941 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:52.548807 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:52.549259 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:52.549682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:52.570372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:52.577925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-01b11581-a7e7-42a9-a7f7-2f8c6600e71d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.158798 Aug 08 00:38:52.578490 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 368/738] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:52 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:52.678136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:52.686482 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:52.687976 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:52.689151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-246aff21-33e7-42f3-93a4-440fb9dc5428 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1722 microversion: 2.20 time: 0.153626 Aug 08 00:38:52.689711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 371/739] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:52 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:53.466386 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d67ebb68-d3cb-4faf-b1ff-c3eefe390055 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:53.466979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d67ebb68-d3cb-4faf-b1ff-c3eefe390055 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:53.473293 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d67ebb68-d3cb-4faf-b1ff-c3eefe390055 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:53.474309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d67ebb68-d3cb-4faf-b1ff-c3eefe390055 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:53.475270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d67ebb68-d3cb-4faf-b1ff-c3eefe390055 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:53.476487 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d67ebb68-d3cb-4faf-b1ff-c3eefe390055 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:53.476953 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d67ebb68-d3cb-4faf-b1ff-c3eefe390055 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:53.477383 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d67ebb68-d3cb-4faf-b1ff-c3eefe390055 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:53.500946 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d67ebb68-d3cb-4faf-b1ff-c3eefe390055 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/ips" status: 200 len: 151 microversion: 2.1 time: 0.038401 Aug 08 00:38:53.501516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 369/740] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:38:53 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:38:53.600487 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:53.601094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:53.607482 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:53.607971 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:53.608401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:53.609093 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:53.609539 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:53.609964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:53.712958 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:53.718001 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:53.719873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:53.720732 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:53.721315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:53.722163 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:53.722777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:53.723434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:53.752445 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:53.761986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-dad10678-26d1-4be8-b0e4-4328794dc25d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.165963 Aug 08 00:38:53.763044 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 372/741] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:53 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:53.857394 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:53.866746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:53.868673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:53.869654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f30af7a0-ea34-40d1-930f-df069f41344f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1722 microversion: 2.20 time: 0.160828 Aug 08 00:38:53.870215 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 370/742] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:53 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:54.782925 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:54.783622 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:54.786174 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:54.791171 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:54.791731 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:54.792224 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:54.793028 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:54.793522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:54.793995 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:54.893827 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:54.894431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:54.902966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:54.902966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:54.902966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:54.904235 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:54.904235 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:54.904621 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:54.926706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:54.936196 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4602269b-1afb-43d6-a1a9-eb3001d84b5c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.157174 Aug 08 00:38:54.937324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 373/743] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:54 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:55.046623 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:55.054633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:55.056159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:55.057372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-192fee5a-1d10-493d-af48-849c78f4fef9 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1725 microversion: 2.20 time: 0.167378 Aug 08 00:38:55.057937 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 371/744] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:54 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:55.081814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0e34c616-2308-4c4c-9054-c4e667c586ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42f4b5d7-9a44-4017-b236-b77839f627ad"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:55.085333 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0e34c616-2308-4c4c-9054-c4e667c586ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:55.091915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e34c616-2308-4c4c-9054-c4e667c586ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:55.092477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e34c616-2308-4c4c-9054-c4e667c586ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:55.094401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e34c616-2308-4c4c-9054-c4e667c586ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:55.095143 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e34c616-2308-4c4c-9054-c4e667c586ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:55.095660 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e34c616-2308-4c4c-9054-c4e667c586ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:55.096324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e34c616-2308-4c4c-9054-c4e667c586ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:55.152286 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-779cf85b-9fba-4fa8-822a-ef842aa0ec95 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ecfe5ed-340a-4fd2-b53f-e72aebf13d67"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:55.156114 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-779cf85b-9fba-4fa8-822a-ef842aa0ec95 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:55.161569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779cf85b-9fba-4fa8-822a-ef842aa0ec95 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:55.162063 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779cf85b-9fba-4fa8-822a-ef842aa0ec95 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:55.162500 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779cf85b-9fba-4fa8-822a-ef842aa0ec95 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:55.163484 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779cf85b-9fba-4fa8-822a-ef842aa0ec95 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:55.163854 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779cf85b-9fba-4fa8-822a-ef842aa0ec95 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:55.164279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-779cf85b-9fba-4fa8-822a-ef842aa0ec95 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:56.072377 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:56.149370 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-779cf85b-9fba-4fa8-822a-ef842aa0ec95 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.000847 Aug 08 00:38:56.150136 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 372/745] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:38:55 2022] POST /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments => generated 194 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:38:56.184624 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:56.184624 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:56.189736 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:56.190468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:56.190905 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:56.191723 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:56.193303 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:56.193900 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:56.346402 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0e34c616-2308-4c4c-9054-c4e667c586ec tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.259329 Aug 08 00:38:56.346402 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 374/746] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Aug 8 00:38:55 2022] POST /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/os-volume_attachments => generated 188 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 08 00:38:56.382228 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:56.395505 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1fdf068d-4318-4d56-a3fb-148f5ab2af82 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.238493 Aug 08 00:38:56.408997 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 373/747] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:56 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:56.452140 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-2d9ce832-21cf-40bd-9047-70a394c56e62 req-a9a78f0d-d976-4a8c-b808-f77393dbde91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf02d3a-b426-4135-a94a-9048d7515184", "name": "network-vif-unplugged", "status": "completed", "tag": "434deac6-5c7d-4020-9d69-11e8d0ac4767"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:56.466142 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-2d9ce832-21cf-40bd-9047-70a394c56e62 req-a9a78f0d-d976-4a8c-b808-f77393dbde91 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:56.468094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-2d9ce832-21cf-40bd-9047-70a394c56e62 req-a9a78f0d-d976-4a8c-b808-f77393dbde91 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:56.468094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-2d9ce832-21cf-40bd-9047-70a394c56e62 req-a9a78f0d-d976-4a8c-b808-f77393dbde91 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:56.486491 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.compute.server_external_events [req-2d9ce832-21cf-40bd-9047-70a394c56e62 req-a9a78f0d-d976-4a8c-b808-f77393dbde91 service nova] Unable to find a host for instance 0cf02d3a-b426-4135-a94a-9048d7515184. Dropping event network-vif-unplugged {{(pid=130173) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 00:38:56.487442 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-2d9ce832-21cf-40bd-9047-70a394c56e62 req-a9a78f0d-d976-4a8c-b808-f77393dbde91 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039227 Aug 08 00:38:56.488050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 375/748] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 08 00:38:56.547478 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0afa28f3-6473-451f-8f0c-cca4d0c61db4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:56.547942 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0afa28f3-6473-451f-8f0c-cca4d0c61db4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:56.553993 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0afa28f3-6473-451f-8f0c-cca4d0c61db4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:56.554560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0afa28f3-6473-451f-8f0c-cca4d0c61db4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:56.555060 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0afa28f3-6473-451f-8f0c-cca4d0c61db4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:56.555784 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0afa28f3-6473-451f-8f0c-cca4d0c61db4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:56.556233 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0afa28f3-6473-451f-8f0c-cca4d0c61db4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:56.556650 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0afa28f3-6473-451f-8f0c-cca4d0c61db4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:57.189619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0afa28f3-6473-451f-8f0c-cca4d0c61db4 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/os-volume_attachments/42f4b5d7-9a44-4017-b236-b77839f627ad" status: 202 len: 0 microversion: 2.20 time: 0.646297 Aug 08 00:38:57.189619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 374/749] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Aug 8 00:38:56 2022] DELETE /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/os-volume_attachments/42f4b5d7-9a44-4017-b236-b77839f627ad => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:38:57.252597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:38:57.253197 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:57.264847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:57.265525 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:57.266404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:57.267587 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:57.268053 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:57.268480 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:57.319463 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130173) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 00:38:57.416349 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:57.416824 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:57.423717 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:57.424192 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:57.424612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:57.425308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:57.425757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:57.426177 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:57.564480 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:57.572833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7fec1ef4-ff82-4c83-9469-0ac59f8383ca tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.160504 Aug 08 00:38:57.576518 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 375/750] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:57 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:38:57.604295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2791f1ba-fbee-45ea-b009-383c019d934c tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "POST /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/action" status: 202 len: 0 microversion: 2.20 time: 0.355439 Aug 08 00:38:57.605693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 376/751] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Aug 8 00:38:57 2022] POST /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:38:57.616654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:57.617486 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:57.624148 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:57.624750 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:57.625468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:57.626242 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:57.626754 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:57.627206 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:57.759362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:57.768870 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:57.770875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:57.772365 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-bd97f036-5d4b-4f86-bf2e-6bb2e8e04bc5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1673 microversion: 2.20 time: 0.160618 Aug 08 00:38:57.773422 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 376/752] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:57 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:38:58.597434 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:58.598141 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:58.604999 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:58.605646 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:58.606079 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:58.606885 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:58.607576 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:58.608105 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:58.628375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:38:58.756961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:58.764503 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-383980ea-273c-4bcf-bab8-0fd51d6bbd19 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.171821 Aug 08 00:38:58.765063 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 377/753] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:58 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:38:58.795535 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:58.797323 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:58.802577 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:58.803059 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:58.803534 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:58.804231 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:58.804686 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:58.805108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:58.944102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:58.952928 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:58.954606 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:38:58.955904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a44f8ee6-9ce0-4296-8634-0ac1fa4daaef tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1673 microversion: 2.20 time: 0.164249 Aug 08 00:38:58.956545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 377/754] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:58 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:38:59.790663 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:59.791400 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:59.797610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:59.798085 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:59.798515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:59.799215 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:59.799682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:59.800099 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:59.980244 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:38:59.982760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:38:59.991023 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:59.992112 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:59.992554 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:38:59.993674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:38:59.994489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:38:59.995115 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:00.007407 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:00.015652 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a3eb3173-06cc-4a05-bbf9-8f80b49eef43 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.233812 Aug 08 00:39:00.016531 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 378/755] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:38:59 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:00.131103 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:00.138958 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:00.140468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:00.141636 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-433a4815-da25-4129-a8c2-bff425332ec5 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.166458 Aug 08 00:39:00.142880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 378/756] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:38:59 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:39:01.018868 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1693529661", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "networks": [{"uuid": "5d335768-2822-40df-af2e-ce286fc9bfdf"}]}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:01.037694 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:01.038648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:01.045572 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:01.046056 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:01.046484 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:01.047176 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:01.047650 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:01.048092 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:01.073850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] validate_networks() for [('5d335768-2822-40df-af2e-ce286fc9bfdf', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:39:01.190732 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:01.201431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-67877a91-7202-4494-806b-d83803992a98 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.168216 Aug 08 00:39:01.202627 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 379/757] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:01 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:01.208474 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:01.209588 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:01.217799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:01.218646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:01.219364 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:01.220328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:01.221027 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:01.221680 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:01.625126 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:01.633905 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:01.646724 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:01.648338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3fda3584-3fcb-4fcd-8b74-6eb6fb531bd2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.443777 Aug 08 00:39:01.649054 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 380/758] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:01 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:01.711875 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:39:01.712495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:39:01.713138 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:39:01.713697 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:39:01.714275 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:39:01.725090 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:01.725573 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:01.726006 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:01.731309 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:01.731309 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:01.731309 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:01.746017 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Getting quotas for project 2aabdf53ddce4b91a70bdb6a287cb765. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:39:01.750333 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Getting quotas for user 0a96c63741ad44bf946ba40b6e16d793 and project 2aabdf53ddce4b91a70bdb6a287cb765. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:39:01.762020 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:39:01.764330 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:39:01.894163 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ac2f6659-13d9-4449-80bd-a9a4865d6c42 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879007 Aug 08 00:39:01.896160 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 379/759] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:39:01.907629 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c733cda8-05fd-4ace-8626-4a4dc6bbc386 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:01.908234 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c733cda8-05fd-4ace-8626-4a4dc6bbc386 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:01.977239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c733cda8-05fd-4ace-8626-4a4dc6bbc386 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:01.985042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c733cda8-05fd-4ace-8626-4a4dc6bbc386 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1214 microversion: 2.1 time: 0.081328 Aug 08 00:39:01.985689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 381/760] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:01 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:02.228056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:02.229447 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:02.236757 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:02.237296 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:02.237831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:02.239382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:02.240167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:02.240664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:02.396056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:02.404610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-7e7f16e7-2ca6-47fe-b1bd-2171f9ad4b3d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.180404 Aug 08 00:39:02.405199 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 380/761] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:02 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:02.671763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:02.672443 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:02.675943 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=52 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:02.693837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:02.694319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:02.694751 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:02.695702 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:02.696155 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:02.696573 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:02.837223 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:02.845599 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:02.847714 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:02.849601 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-030d8c16-928f-4361-b742-4121fde3424d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.181844 Aug 08 00:39:02.861385 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 382/762] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:02 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:39:03.009261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:03.009873 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:03.016854 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:03.017748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:03.018392 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:03.019476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:03.020240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:03.020899 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:03.085249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:03.092733 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bd20326e-98b2-47fd-b323-0edb1a999b1b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1218 microversion: 2.1 time: 0.087875 Aug 08 00:39:03.093302 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 381/763] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:03 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:03.426284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:03.427089 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:03.434095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:03.434612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:03.435266 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:03.435969 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:03.436449 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:03.436873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:03.590362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:03.599025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7901cc7d-3554-45e1-b844-789b0836358c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.176139 Aug 08 00:39:03.599894 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 383/764] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:03 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:03.876453 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:03.877044 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:03.884104 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:03.884577 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:03.885012 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:03.885732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:03.886184 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:03.886605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:04.023273 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:04.032236 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:04.034105 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:04.035311 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8d687e77-bd79-4a17-82b9-73d8a4feb261 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.163203 Aug 08 00:39:04.036240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 382/765] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:03 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:04.115742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:04.116352 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:04.123861 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:04.124351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:04.124788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:04.125495 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:04.125946 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:04.126370 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:04.197019 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:04.204885 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7cdf1680-d98a-4a35-ba3b-1c99685c351b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1218 microversion: 2.1 time: 0.093322 Aug 08 00:39:04.205491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 384/766] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:04 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:04.621100 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:04.621701 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:04.627632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:04.628103 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:04.628530 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:04.629274 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:04.629728 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:04.630188 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:04.776822 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:04.787907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-62241f2b-d9d9-4bea-bbf6-576118c39a05 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.168232 Aug 08 00:39:04.796017 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 383/767] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:04 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:05.058908 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:05.059612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:05.067214 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:05.067747 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:05.068265 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:05.069167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:05.069782 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:05.070221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:05.211682 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:05.220764 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:05.226412 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:05.227035 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:05.229101 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:05.230551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7262bda2-965c-4cf1-b665-b4a6dc662023 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.176480 Aug 08 00:39:05.231554 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 385/768] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:05 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:05.249106 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:05.249608 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:05.250054 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:05.250780 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:05.251252 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:05.251706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:05.325521 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:05.335179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6be8b542-4bfd-49af-8a67-85a216dd9076 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1218 microversion: 2.1 time: 0.111743 Aug 08 00:39:05.335937 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 384/769] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:05 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:05.814616 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:05.815214 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:05.822778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:05.829161 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:05.829161 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:05.829161 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:05.829161 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:05.829756 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:05.982416 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:05.992587 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c0b3b19b-0246-4d24-841a-f47fddb0cbee tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.182054 Aug 08 00:39:05.993421 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 386/770] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:05 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:06.254061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:06.254699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:06.262156 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:06.262873 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:06.263498 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:06.264373 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:06.264975 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:06.265562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:06.355972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:06.356598 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:06.363135 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:06.363720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:06.364160 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:06.364864 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:06.365906 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:06.366411 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:06.414003 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:06.423966 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:06.425786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:06.427181 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-494352bf-e8c5-4330-bbed-5dab814fc918 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.177013 Aug 08 00:39:06.429217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 385/771] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:06 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:06.437092 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:06.440926 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:06.446169 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-47833223-0d42-4bc8-ad5b-22eea29c58ad tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1218 microversion: 2.1 time: 0.094101 Aug 08 00:39:06.447922 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 387/772] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:06 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:07.014382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:07.015054 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:07.026277 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:07.026989 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:07.027794 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:07.032076 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:07.034334 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:07.034822 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:07.201702 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:07.209623 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-67c1b0d8-0247-433c-a0d2-2ea07246d6b4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.199724 Aug 08 00:39:07.210308 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 386/773] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:07 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:07.452890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:07.453876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:07.461547 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:07.462167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:07.462664 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:07.463401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:07.463979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:07.464456 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:07.471792 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:07.472422 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:07.480297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:07.480793 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:07.481244 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:07.481949 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:07.482809 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:07.483269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:07.572574 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:07.579994 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-da8ffcd0-03b9-49f4-8b19-5452eabb7341 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1218 microversion: 2.1 time: 0.112425 Aug 08 00:39:07.580560 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 387/774] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:07 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:07.630545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:07.640297 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:07.642102 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:07.643689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ee5862b8-1a2f-4303-956b-f77fd868d48b tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.195452 Aug 08 00:39:07.644949 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 388/775] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:07 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:08.231473 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:08.232127 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:08.238778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:08.239364 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:08.239811 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:08.240600 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:08.241245 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:08.241989 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:08.384264 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:08.393318 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fc5fdf46-6c7e-4a9a-86cd-aef9bef9d494 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.166075 Aug 08 00:39:08.394986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 388/776] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:08 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:08.601198 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:08.601797 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:08.608151 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:08.608630 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:08.609057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:08.609740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:08.610186 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:08.610604 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:08.671027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:08.671027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:08.676127 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:08.677587 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:08.678084 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:08.679032 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:08.680371 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:08.680371 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:08.681097 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:08.685135 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-68af2aa6-b29c-4891-b04b-fd736e398cce tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1218 microversion: 2.1 time: 0.087578 Aug 08 00:39:08.686085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 389/777] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:08 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:08.822617 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:08.831538 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:08.835332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:08.835332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-549fae4b-471e-47df-b124-7ab53c15cc92 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.172471 Aug 08 00:39:08.835679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 389/778] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:08 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:39:09.416010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:09.416523 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:09.422834 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:09.423351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:09.423787 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:09.424480 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:09.424934 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:09.425358 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:09.594876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:09.603578 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6b7a7468-0048-4bce-bbc7-949dddd8fbbd tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.192164 Aug 08 00:39:09.612573 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 390/779] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:09 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:09.708214 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:09.709095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:09.715775 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:09.716253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:09.716680 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:09.717364 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:09.717813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:09.718239 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:09.789227 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:09.794472 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-64cb0703-55e5-4fb0-aede-8468cfa68270 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1218 microversion: 2.1 time: 0.090044 Aug 08 00:39:09.795036 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 390/780] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:09 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:09.857999 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:09.858650 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:09.865708 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:09.866799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:09.867587 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:09.871278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:09.871278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:09.871278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:10.008741 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:10.016808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:10.018289 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:10.019465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-cb7f23d8-5ecf-465e-a814-195f3538c72f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.165724 Aug 08 00:39:10.020008 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 391/781] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:09 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:10.624463 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:10.625076 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:10.631026 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:10.631537 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:10.632700 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:10.633390 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:10.633842 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:10.634270 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:10.773470 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:10.781042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ced5270f-9719-43c5-b1bf-658a98b54ca4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.160442 Aug 08 00:39:10.781654 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 391/782] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:10 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:10.816663 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:10.817302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:10.824140 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:10.824618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:10.825048 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:10.825737 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:10.826181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:10.826602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:10.887039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:10.894572 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a2f2486b-f67b-4bc2-b769-b99d8fc578cd tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1218 microversion: 2.1 time: 0.081703 Aug 08 00:39:10.895132 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 392/783] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:10 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:11.042142 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:11.042783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:11.048778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:11.049255 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:11.049690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:11.050378 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:11.050832 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:11.051284 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:11.215134 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:11.221169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:11.222657 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:11.223830 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-84c886af-18d6-434d-a693-81b32f947407 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.185558 Aug 08 00:39:11.224397 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 392/784] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:11 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:11.801899 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:11.802508 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:11.809033 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:11.809507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:11.809942 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:11.810637 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:11.811094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:11.811546 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:11.916380 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:11.917022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:11.919348 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:11.920317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=6 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:11.925167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:11.925582 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:11.926015 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:11.926712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:11.927160 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:11.927608 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:11.946414 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:11.954380 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8802f801-e520-44c2-baaa-2ad8ac1da9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.156332 Aug 08 00:39:11.954951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 393/785] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:11 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:11.988061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:11.995617 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-24adc100-5f57-4a5c-9c3d-5d96ed9e2bde tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1210 microversion: 2.1 time: 0.084006 Aug 08 00:39:11.996176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 393/786] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:11 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:12.247800 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:12.248415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:12.250709 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:12.255668 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:12.256212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:12.260062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:12.260062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:12.260062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:12.260062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:12.400241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:12.408452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:12.410018 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:12.411191 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c1bb8ce8-bafa-4c97-bb76-1de8a5f5769f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.167673 Aug 08 00:39:12.411768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 394/787] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:12 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:12.979286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:12.980059 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:12.986932 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:12.988088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:12.988088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:12.988879 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:12.989573 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:12.990063 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:13.016641 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:13.017235 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:13.024830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:13.025502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:13.025997 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:13.026791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:13.027408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:13.027840 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:13.097036 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:13.107677 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3409d10f-d99d-4ee7-9f14-17e0fb9cf280 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1266 microversion: 2.1 time: 0.094637 Aug 08 00:39:13.109505 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 395/788] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:13 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:13.309154 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:13.312712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=100 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:13.317709 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-801b8e70-4195-4c12-99ee-44f7a2b7278d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.344372 Aug 08 00:39:13.318285 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 394/789] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:12 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:13.433973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:13.434599 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:13.440519 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:13.440998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:13.441430 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:13.442113 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:13.442558 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:13.442977 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:13.577543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:13.582257 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ecfe5ed-340a-4fd2-b53f-e72aebf13d67"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:13.585920 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:13.586657 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:13.588171 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:13.589448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-42663efd-b3ad-4c1b-ae4d-7d0922715749 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.159451 Aug 08 00:39:13.590000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 396/790] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:13 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:13.592544 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:13.593103 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:13.593653 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:13.594516 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:13.594979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:13.595431 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:13.673177 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Invalid volume: volume 4ecfe5ed-340a-4fd2-b53f-e72aebf13d67 is already attached to instances: 1c80c22a-1596-4b59-a033-7c82163e2b00 Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: POST /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments HTTP/1.1 Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 74 Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:39:13.674956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {"volumeAttachment": {"volumeId": "4ecfe5ed-340a-4fd2-b53f-e72aebf13d67"}} Aug 08 00:39:13.676717 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Invalid volume: volume 4ecfe5ed-340a-4fd2-b53f-e72aebf13d67 is already attached to instances: 1c80c22a-1596-4b59-a033-7c82163e2b00 Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'server_id': '1c80c22a-1596-4b59-a033-7c82163e2b00', 'body': {'volumeAttachment': {'volumeId': '4ecfe5ed-340a-4fd2-b53f-e72aebf13d67'}}} Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4ecfe5ed-340a-4fd2-b53f-e72aebf13d67 is already attached to instances: 1c80c22a-1596-4b59-a033-7c82163e2b00 Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:13.677689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4ecfe5ed-340a-4fd2-b53f-e72aebf13d67 is already attached to instances: 1c80c22a-1596-4b59-a033-7c82163e2b00 Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:13.679310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:13.680802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:13.680802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:39:13.680802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:39:13.680802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4ecfe5ed-340a-4fd2-b53f-e72aebf13d67 is already attached to instances: 1c80c22a-1596-4b59-a033-7c82163e2b00 Aug 08 00:39:13.680802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:13.680802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 400 to user: Invalid volume: volume 4ecfe5ed-340a-4fd2-b53f-e72aebf13d67 is already attached to instances: 1c80c22a-1596-4b59-a033-7c82163e2b00 {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:39:13.680802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-230eb638-b1c5-4324-90ea-502676046db3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098508 Aug 08 00:39:13.680802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 395/791] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:39:13 2022] POST /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 08 00:39:13.744807 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:13.749284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:13.751271 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:13.751749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:13.752182 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:13.752936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:13.753383 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:13.753799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:13.833350 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'services' on Instance uuid 1c80c22a-1596-4b59-a033-7c82163e2b00 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:39:14.051741 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-19618f49-a550-4df3-8936-d81e8eab1d5a tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments/4ecfe5ed-340a-4fd2-b53f-e72aebf13d67" status: 202 len: 0 microversion: 2.1 time: 0.311617 Aug 08 00:39:14.052372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 397/792] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:39:13 2022] DELETE /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments/4ecfe5ed-340a-4fd2-b53f-e72aebf13d67 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:39:14.061051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2d09acdf-896d-4cfb-8ec7-7b5090028336 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:14.063256 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2d09acdf-896d-4cfb-8ec7-7b5090028336 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:14.071058 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d09acdf-896d-4cfb-8ec7-7b5090028336 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:14.071560 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d09acdf-896d-4cfb-8ec7-7b5090028336 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:14.071994 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d09acdf-896d-4cfb-8ec7-7b5090028336 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:14.072682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d09acdf-896d-4cfb-8ec7-7b5090028336 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:14.073135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d09acdf-896d-4cfb-8ec7-7b5090028336 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:14.073553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2d09acdf-896d-4cfb-8ec7-7b5090028336 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:14.101404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2d09acdf-896d-4cfb-8ec7-7b5090028336 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Aug 08 00:39:14.101951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 396/793] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:39:14 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:14.130008 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:14.130758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:14.137616 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:14.138095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:14.138532 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:14.139254 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:14.139704 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:14.140130 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:14.202990 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:14.210882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6344847e-b19f-4d0a-9a38-ffc8197e175c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1272 microversion: 2.1 time: 0.085001 Aug 08 00:39:14.211416 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 398/794] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:14 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:14.338387 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:14.339026 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:14.344951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:14.345432 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:14.345867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:14.346559 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:14.347011 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:14.347478 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:14.486849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:14.495977 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-11d11d9b-7103-4cf3-8d79-28bffaeeb12e tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.161430 Aug 08 00:39:14.496560 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 397/795] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:14 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:14.612461 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:14.613076 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:14.619167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:14.619675 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:14.620111 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:14.620810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:14.621267 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:14.621692 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:14.764203 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:14.775518 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:14.777328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:14.777525 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d9c2ffbb-b02e-470e-8477-67b30063a8fe tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.169045 Aug 08 00:39:14.778324 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 399/796] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:14 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:15.114169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f3d4a7ed-921f-4985-ae67-e31a3b4836d9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:15.116466 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f3d4a7ed-921f-4985-ae67-e31a3b4836d9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:15.122782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3d4a7ed-921f-4985-ae67-e31a3b4836d9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.123365 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3d4a7ed-921f-4985-ae67-e31a3b4836d9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.123867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3d4a7ed-921f-4985-ae67-e31a3b4836d9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.124557 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3d4a7ed-921f-4985-ae67-e31a3b4836d9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.125083 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3d4a7ed-921f-4985-ae67-e31a3b4836d9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.125589 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3d4a7ed-921f-4985-ae67-e31a3b4836d9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.157241 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f3d4a7ed-921f-4985-ae67-e31a3b4836d9 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Aug 08 00:39:15.157789 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 398/797] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:39:15 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:15.231707 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:15.232297 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:15.239107 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.239687 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.240126 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.241142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.241611 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.242030 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.310498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:15.318394 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8cee5e64-8679-497a-87e4-4469bad0ff8f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1272 microversion: 2.1 time: 0.090531 Aug 08 00:39:15.319621 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 400/798] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:15 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:15.439461 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:15.439959 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:15.446160 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.446641 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.447079 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.447811 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.448269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.448693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.479257 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:39:15.519989 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:15.520849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:15.535010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.536380 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.536825 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.537544 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.538655 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.539128 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.678115 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:15.685673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fd13af4b-0a8a-424b-a46f-ee8545556c4b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.171484 Aug 08 00:39:15.686243 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 401/799] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:15 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:15.807020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:15.807896 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:15.818374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.818374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.818374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.818374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.818830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.818830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.887044 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-779cdbc2-328f-4955-b12f-35933c55a9cf tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 204 len: 0 microversion: 2.1 time: 0.451230 Aug 08 00:39:15.887684 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 399/800] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:39:15 2022] DELETE /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:39:15.896169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:15.896922 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:15.903327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.903872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.904363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.905118 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:15.905632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:15.906137 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:15.981280 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:15.989447 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:15.992096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:15.994189 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-161b9564-630f-4043-8024-d5b926677ff2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.192434 Aug 08 00:39:16.010746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 402/801] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:15 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:39:16.143164 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:16.151047 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-499f87c4-95d2-4b42-8613-8eb0fa0954b8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1577 microversion: 2.1 time: 0.258872 Aug 08 00:39:16.151649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 400/802] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:15 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1577 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:16.170101 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5ad04021-0073-4241-b735-90330d4c4628 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:16.172396 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5ad04021-0073-4241-b735-90330d4c4628 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:16.178457 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ad04021-0073-4241-b735-90330d4c4628 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:16.179082 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ad04021-0073-4241-b735-90330d4c4628 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:16.179544 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ad04021-0073-4241-b735-90330d4c4628 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:16.180232 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ad04021-0073-4241-b735-90330d4c4628 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:16.180680 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ad04021-0073-4241-b735-90330d4c4628 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:16.181100 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ad04021-0073-4241-b735-90330d4c4628 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:16.205838 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:16.211314 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5ad04021-0073-4241-b735-90330d4c4628 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Aug 08 00:39:16.212091 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 403/803] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:39:16 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:16.340665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:16.341219 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:16.347202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:16.347715 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:16.348149 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:16.348839 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:16.349291 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:16.349714 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:16.482981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:16.490613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-af88bbc3-2a07-4779-9503-618c6079811b tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.153932 Aug 08 00:39:16.491417 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 401/804] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:16 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:16.705890 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:16.706581 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:16.714956 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:16.715475 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:16.715910 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:16.716605 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:16.717053 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:16.717468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:16.746572 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-b75232c3-c1ee-4d31-9bc9-e2a32b2f9537 req-4a9ae3bf-f8a9-4d7a-8a73-822d94b082bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf02d3a-b426-4135-a94a-9048d7515184", "name": "network-vif-plugged", "status": "completed", "tag": "434deac6-5c7d-4020-9d69-11e8d0ac4767"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:16.758270 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b75232c3-c1ee-4d31-9bc9-e2a32b2f9537 req-4a9ae3bf-f8a9-4d7a-8a73-822d94b082bb service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:16.758830 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b75232c3-c1ee-4d31-9bc9-e2a32b2f9537 req-4a9ae3bf-f8a9-4d7a-8a73-822d94b082bb service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:16.759286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-b75232c3-c1ee-4d31-9bc9-e2a32b2f9537 req-4a9ae3bf-f8a9-4d7a-8a73-822d94b082bb service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:16.771128 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-b75232c3-c1ee-4d31-9bc9-e2a32b2f9537 req-4a9ae3bf-f8a9-4d7a-8a73-822d94b082bb service nova] Creating event network-vif-plugged:434deac6-5c7d-4020-9d69-11e8d0ac4767 for instance 0cf02d3a-b426-4135-a94a-9048d7515184 on hv-cinder-85164 Aug 08 00:39:16.777052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-b75232c3-c1ee-4d31-9bc9-e2a32b2f9537 req-4a9ae3bf-f8a9-4d7a-8a73-822d94b082bb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034046 Aug 08 00:39:16.777659 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 402/805] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:39:16.852224 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:16.860143 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0002a676-e20e-4aca-a028-4ef5e2ea6e5b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.158077 Aug 08 00:39:16.860718 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 404/806] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:16 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:17.018216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:17.018915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:17.025136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.025627 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.026065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:17.029820 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.029820 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.029820 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:17.162432 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:17.171155 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:17.172693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:17.173180 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:17.173795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:17.173924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-61dad003-41cb-409c-984d-2dd364328b96 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.159944 Aug 08 00:39:17.174523 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 403/807] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:17 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:17.180322 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.180808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.181254 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:17.181955 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.182412 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.182839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:17.222985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f3c2d6d0-b617-4c25-b411-444b7f5ff7dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:17.225314 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f3c2d6d0-b617-4c25-b411-444b7f5ff7dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:17.231758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3c2d6d0-b617-4c25-b411-444b7f5ff7dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.232257 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3c2d6d0-b617-4c25-b411-444b7f5ff7dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.232699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3c2d6d0-b617-4c25-b411-444b7f5ff7dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:17.233406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3c2d6d0-b617-4c25-b411-444b7f5ff7dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.233863 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3c2d6d0-b617-4c25-b411-444b7f5ff7dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.234294 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f3c2d6d0-b617-4c25-b411-444b7f5ff7dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:17.271211 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f3c2d6d0-b617-4c25-b411-444b7f5ff7dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052021 Aug 08 00:39:17.272858 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 404/808] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:39:17 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:39:17.330440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:17.339745 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-da0ac2d1-3f11-427f-a926-251ae00e8f4f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1577 microversion: 2.1 time: 0.170460 Aug 08 00:39:17.340321 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 405/809] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:17 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:17.512672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:17.513330 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:17.520947 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.521607 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.522874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:17.523903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.524559 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.525178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:17.761990 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:17.772690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d268ba76-df66-4582-9564-0d0b9987e4e5 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.262117 Aug 08 00:39:17.785864 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 405/810] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:17 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:17.883356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:17.884815 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:17.892789 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.893283 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.894098 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:17.895062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:17.896479 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:17.897194 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.138583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:18.143961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-67ae1632-ad5b-4b0c-8b24-48cce3cdfaa5 req-e3baad4a-0f8d-4994-8297-3dbfffbe9611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd7eaeb-e187-4f41-b379-f063843b6490", "tag": "2911615a-80a4-48f6-87fc-1535c284a643"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:18.149307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8eea4f16-6891-4880-b0d8-b884a007c9a7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1567 microversion: 2.1 time: 0.271130 Aug 08 00:39:18.159903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 406/811] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:17 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:18.171961 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:18.172822 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:18.178511 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-67ae1632-ad5b-4b0c-8b24-48cce3cdfaa5 req-e3baad4a-0f8d-4994-8297-3dbfffbe9611 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.179017 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.179111 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-67ae1632-ad5b-4b0c-8b24-48cce3cdfaa5 req-e3baad4a-0f8d-4994-8297-3dbfffbe9611 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.179209 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.179514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.179688 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-67ae1632-ad5b-4b0c-8b24-48cce3cdfaa5 req-e3baad4a-0f8d-4994-8297-3dbfffbe9611 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.180393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.180843 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.181264 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.195993 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-67ae1632-ad5b-4b0c-8b24-48cce3cdfaa5 req-e3baad4a-0f8d-4994-8297-3dbfffbe9611 service nova] Creating event network-changed:2911615a-80a4-48f6-87fc-1535c284a643 for instance dbd7eaeb-e187-4f41-b379-f063843b6490 on hv-cinder-85164 Aug 08 00:39:18.201043 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-67ae1632-ad5b-4b0c-8b24-48cce3cdfaa5 req-e3baad4a-0f8d-4994-8297-3dbfffbe9611 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062567 Aug 08 00:39:18.202146 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 406/812] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:39:18.207921 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:18.208998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:18.214238 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130172) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 08 00:39:18.216567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.217124 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.217627 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.218457 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.219036 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.219554 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.400073 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:18.417347 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:18.418913 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:18.428726 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d52cb10c-82a0-4a21-a7c0-1b50324ce9ac tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.216653 Aug 08 00:39:18.428726 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 407/813] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:18 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:18.428726 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d57dc677-3117-4f36-877a-ddb8dfb34c96 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:18.428726 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d57dc677-3117-4f36-877a-ddb8dfb34c96 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:18.435738 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d57dc677-3117-4f36-877a-ddb8dfb34c96 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.436208 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d57dc677-3117-4f36-877a-ddb8dfb34c96 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.436705 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d57dc677-3117-4f36-877a-ddb8dfb34c96 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.437951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d57dc677-3117-4f36-877a-ddb8dfb34c96 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.438399 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d57dc677-3117-4f36-877a-ddb8dfb34c96 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.438826 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d57dc677-3117-4f36-877a-ddb8dfb34c96 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.477903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d57dc677-3117-4f36-877a-ddb8dfb34c96 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056153 Aug 08 00:39:18.478501 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 408/814] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:39:18 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 00:39:18.483238 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:18.483951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:18.490568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.491917 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.492571 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.493303 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.493767 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.494624 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.566894 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:18.574684 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fd7f9be3-4ada-43ab-ba54-27fb4ff55520 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1510 microversion: 2.1 time: 0.095199 Aug 08 00:39:18.575286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 409/815] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:18 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1510 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:18.579683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:18.580178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:18.583147 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:18.587345 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.587955 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.588274 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.588978 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.589450 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.589869 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.616813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:39:18.627875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-badcea87-8874-4188-8d5a-849414446500 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "POST /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3/action" status: 202 len: 0 microversion: 2.1 time: 0.460577 Aug 08 00:39:18.628855 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 407/816] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:39:18 2022] POST /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:39:18.633482 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:18.640835 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:18.641715 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:18.654135 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.654758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.655494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:18.656476 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:18.657142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:18.657802 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.023147 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:19.031313 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-35795683-39ed-402a-860e-2ee092ed84e8 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1515 microversion: 2.1 time: 0.396050 Aug 08 00:39:19.032499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 408/817] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:18 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1515 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:19.040305 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:19.041166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:19.047740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.048549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.049181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.050564 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.051263 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.052177 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.167278 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-aef65f03-349c-4975-b674-c19b14ca865b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 204 len: 0 microversion: 2.1 time: 0.590367 Aug 08 00:39:19.167557 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 410/818] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:39:18 2022] DELETE /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:39:19.175540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-1db4af88-e47f-4e57-9f91-1e39bb4a409a req-0c499051-c801-405a-822c-bda469c6fbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39cb5181-8bc2-4e47-ab31-1f9524d47ef3", "name": "network-vif-unplugged", "status": "completed", "tag": "1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:19.186415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-1db4af88-e47f-4e57-9f91-1e39bb4a409a req-0c499051-c801-405a-822c-bda469c6fbeb service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.187623 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-1db4af88-e47f-4e57-9f91-1e39bb4a409a req-0c499051-c801-405a-822c-bda469c6fbeb service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.188237 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-1db4af88-e47f-4e57-9f91-1e39bb4a409a req-0c499051-c801-405a-822c-bda469c6fbeb service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.201428 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.compute.server_external_events [req-1db4af88-e47f-4e57-9f91-1e39bb4a409a req-0c499051-c801-405a-822c-bda469c6fbeb service nova] Unable to find a host for instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3. Dropping event network-vif-unplugged {{(pid=130173) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 08 00:39:19.202574 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-1db4af88-e47f-4e57-9f91-1e39bb4a409a req-0c499051-c801-405a-822c-bda469c6fbeb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033793 Aug 08 00:39:19.203378 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 411/819] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 08 00:39:19.209410 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-cb2aa748-b879-40b8-934d-c1dcfdc2457a req-5dfabbf7-e90a-4fc1-8797-4ff0ba5b95e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4b901e-ba2e-4eaa-bb78-47214419d1a0", "name": "network-vif-deleted", "tag": "ef74e25d-7ffe-42e3-9abd-4b9fe8caa2d7"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:19.219542 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-cb2aa748-b879-40b8-934d-c1dcfdc2457a req-5dfabbf7-e90a-4fc1-8797-4ff0ba5b95e5 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.220515 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-cb2aa748-b879-40b8-934d-c1dcfdc2457a req-5dfabbf7-e90a-4fc1-8797-4ff0ba5b95e5 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.220675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-cb2aa748-b879-40b8-934d-c1dcfdc2457a req-5dfabbf7-e90a-4fc1-8797-4ff0ba5b95e5 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.232486 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-cb2aa748-b879-40b8-934d-c1dcfdc2457a req-5dfabbf7-e90a-4fc1-8797-4ff0ba5b95e5 service nova] Creating event network-vif-deleted:ef74e25d-7ffe-42e3-9abd-4b9fe8caa2d7 for instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 on hv-cinder-85164 Aug 08 00:39:19.237887 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-cb2aa748-b879-40b8-934d-c1dcfdc2457a req-5dfabbf7-e90a-4fc1-8797-4ff0ba5b95e5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 Aug 08 00:39:19.243789 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:19.243910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 412/820] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:19.247373 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:19.248078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:19.250202 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0e1581f8-66cc-4a01-abc7-0cb1622eeb05 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.216316 Aug 08 00:39:19.251020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 409/821] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:19 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:19.254282 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.254823 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.255213 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.255975 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.256999 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.257528 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.391382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:19.399715 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5b553a61-01b3-453c-b44b-ffb646d65803 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1682 microversion: 2.1 time: 0.156305 Aug 08 00:39:19.400729 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 413/822] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:19 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:19.443429 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:19.444723 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:19.451196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.451740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.452268 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.452970 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.453426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.453910 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.590201 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:19.597328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:19.597880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:19.600155 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:19.602084 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:19.603285 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-27a537e8-7f55-429b-8f45-5ec8dd3c5066 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.163750 Aug 08 00:39:19.603847 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 410/823] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:19 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 08 00:39:19.605528 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.606189 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.606620 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.607357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:19.607808 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:19.608226 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:19.678127 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:19.685995 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-625e60c8-eb2b-4b05-8591-ada0d7a965f3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1510 microversion: 2.1 time: 0.092450 Aug 08 00:39:19.686751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 414/824] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:19 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:20.052786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:20.053540 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:20.060638 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.061119 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.061572 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.062270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.062721 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.063140 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.192011 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:20.200281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-eb342d7b-5cab-4706-b5d2-41c8ef384dc1 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1515 microversion: 2.1 time: 0.151431 Aug 08 00:39:20.200845 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 411/825] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:20 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:20.273160 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:20.273764 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:20.280125 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.280603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.281038 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.281727 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.282182 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.282608 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.410593 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:20.418009 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-91811efe-a9e0-46d8-9d52-d4332b7ba7d1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.149360 Aug 08 00:39:20.418759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 415/826] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:20 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:20.421883 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:20.422495 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:20.428862 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.429338 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.429775 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.430544 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.430982 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.431440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.563206 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:20.571793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-13bb767e-61ab-43c6-845b-59da729e1f4e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1682 microversion: 2.1 time: 0.153689 Aug 08 00:39:20.572367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 412/827] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:20 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:20.627148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:20.627784 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:20.634431 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.634915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.635379 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.636067 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.636520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.636943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.708332 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:20.709196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:20.715685 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.716171 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.716602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.717300 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:20.717748 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:20.718166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:20.769452 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:20.777677 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:20.779042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:20.780234 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-05c435e8-2c97-47a9-909f-cab12d58dab0 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.156972 Aug 08 00:39:20.780807 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 416/828] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:20 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:20.782520 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:20.790300 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-38942925-8ed1-41a1-b7cc-2100f759a964 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1510 microversion: 2.1 time: 0.085792 Aug 08 00:39:20.790852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 413/829] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:20 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1510 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:21.221641 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:21.226439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:21.236912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.238901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.238901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.238901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.239999 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.239999 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.428959 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:21.438164 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f0a862b8-c2af-4769-af4a-8f02d842c397 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1517 microversion: 2.1 time: 0.220191 Aug 08 00:39:21.451975 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 417/830] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:21 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:21.452129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:21.452129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:21.452129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.452129 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.452777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.452777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.452777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.452777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.593103 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:21.593812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:21.599779 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.601248 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.601685 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.602389 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.602843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.603322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.701945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:21.711203 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-93a31f05-85e1-4ab0-8c48-3f7f356334c0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.275908 Aug 08 00:39:21.712007 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 414/831] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:21 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:21.749847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:21.759723 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4970c04a-83ec-4a9c-92c9-fd9f9da20ee5 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1682 microversion: 2.1 time: 0.170384 Aug 08 00:39:21.760343 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 418/832] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:21 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:21.803621 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:21.804299 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:21.810746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.811238 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.811687 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.812375 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.812820 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.812935 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:21.813532 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.813649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:21.821128 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.821621 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.822716 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.823464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.823924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.824368 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.857481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:21.858023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:21.858466 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:21.858914 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lazy-loading 'fault' on Instance uuid ed4b901e-ba2e-4eaa-bb78-47214419d1a0 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:39:21.903324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:21.911479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-88a4b609-d926-413b-a9d0-0ee4392f7277 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 200 len: 1229 microversion: 2.1 time: 0.102347 Aug 08 00:39:21.912127 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 419/833] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:21 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:21.993279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:22.001410 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:22.002942 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:22.004401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f27cf1d6-6c3f-48aa-ae87-e122161b6d1d tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1731 microversion: 2.20 time: 0.205123 Aug 08 00:39:22.004954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 415/834] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:21 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:22.387300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-493bda3f-36d4-4d34-bda1-c21f3481898f req-6ef65f0d-82cc-41eb-981f-43bb1504b8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c80c22a-1596-4b59-a033-7c82163e2b00", "name": "network-vif-deleted", "tag": "925b229f-7a24-4cd8-9a75-d6005c402efb"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:22.399313 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-493bda3f-36d4-4d34-bda1-c21f3481898f req-6ef65f0d-82cc-41eb-981f-43bb1504b8bd service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.399882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-493bda3f-36d4-4d34-bda1-c21f3481898f req-6ef65f0d-82cc-41eb-981f-43bb1504b8bd service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.400322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-493bda3f-36d4-4d34-bda1-c21f3481898f req-6ef65f0d-82cc-41eb-981f-43bb1504b8bd service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.412085 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-493bda3f-36d4-4d34-bda1-c21f3481898f req-6ef65f0d-82cc-41eb-981f-43bb1504b8bd service nova] Creating event network-vif-deleted:925b229f-7a24-4cd8-9a75-d6005c402efb for instance 1c80c22a-1596-4b59-a033-7c82163e2b00 on hv-cinder-85164 Aug 08 00:39:22.418310 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-493bda3f-36d4-4d34-bda1-c21f3481898f req-6ef65f0d-82cc-41eb-981f-43bb1504b8bd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034901 Aug 08 00:39:22.419247 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 420/835] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:39:22.460481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:22.461119 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:22.467894 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.468396 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.472481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.472481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.472481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.472481 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.644579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:22.661868 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-555e0847-54eb-4793-a680-e3f826f293ae tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1517 microversion: 2.1 time: 0.206650 Aug 08 00:39:22.662586 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 416/836] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:22 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:22.733223 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:22.733934 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:22.740526 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.741163 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.741640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.742415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.742869 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.743328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.781556 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:22.782415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:22.796593 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.797409 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.798125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.799004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.799632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.804869 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.870426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.870950 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.871624 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.872970 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'fault' on Instance uuid 1c80c22a-1596-4b59-a033-7c82163e2b00 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:39:22.920129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:22.924618 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:22.930341 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4980d23c-ed84-416d-a673-0642126847a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.201499 Aug 08 00:39:22.931474 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 421/837] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:22 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:22.935295 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3787a338-ff7c-4f3a-90b9-3c564fda64cd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 200 len: 1330 microversion: 2.1 time: 0.157465 Aug 08 00:39:22.937146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 417/838] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:22 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 1330 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:22.937773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:22.942630 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:22.951186 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.951798 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.952366 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.953191 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:22.953751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:22.954261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:22.974433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] HTTP exception thrown: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Request method failure captured: Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 HTTP/1.1 Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FpjFCxWg70FWQQl9rIKacZPbN4w7caocEk9_WTRmaUCRXlCvoib93fpml7Uz8ekZmx9G7YVI2yqQsUJ_eoc8qDz5SRP1OcUViRY6ryHH9_oL1fdgxgJljw5PvLIQYX4XaEZBe5xECurylkdI6SVPRj4HRZ9ACEEhoU2HWayHsQUIak Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:39:22.976635 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-TestVolumeBootPattern-716752679 Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 322afd3893ac4c2ba4ab4d449f4d9159 Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:39:22.978022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': 'ed4b901e-ba2e-4eaa-bb78-47214419d1a0'} Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:39:22.978803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:39:22.980096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:39:22.981201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Returning 404 to user: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:39:22.981201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6f6d7313-2301-46d0-aa53-dac5d7d12f4d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 404 len: 111 microversion: 2.1 time: 0.045402 Aug 08 00:39:22.981201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 422/839] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:22 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:39:23.030572 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:23.031191 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:23.037213 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:23.037740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:23.038182 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:23.038919 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:23.039457 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:23.039880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:23.096883 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1810329394", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-57551070", "security_groups": [{"name": "tempest-secgroup-smoke-259062108"}], "block_device_mapping_v2": [{"uuid": "f8e2fa4f-7aa0-4810-8e79-ba7c7848328c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e16e278d-24ed-46ec-9b21-78207cc53646"}]}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:23.187999 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:23.196798 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:23.198285 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:23.199714 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6679ad08-3d2c-47f8-b358-7078d5dc96c7 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1718 microversion: 2.20 time: 0.174713 Aug 08 00:39:23.200281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 418/840] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:23 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1718 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:23.252126 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] validate_networks() for [('e16e278d-24ed-46ec-9b21-78207cc53646', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:39:23.650030 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:39:23.650030 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:39:23.650617 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:39:23.654918 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:39:23.655428 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:39:23.664688 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:23.665173 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:23.665631 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:23.670328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:23.670328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:23.670328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:23.683702 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:23.684395 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:23.685093 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Getting quotas for project a22da44baa6b472e91d99fbcb03b583c. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:39:23.689358 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Getting quotas for user 322afd3893ac4c2ba4ab4d449f4d9159 and project a22da44baa6b472e91d99fbcb03b583c. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:39:23.690871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:23.691400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:23.693139 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:23.693139 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:23.693139 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:23.693437 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:23.698206 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:23.747829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:39:23.749905 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8e2fa4f-7aa0-4810-8e79-ba7c7848328c',volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:39:23.831486 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:23.840215 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7a8ac668-c4a6-401e-b409-6483a2266770 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.160524 Aug 08 00:39:23.841012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 419/841] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:23 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:23.952230 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:23.952842 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:23.959503 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:23.960008 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:23.960485 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:23.961185 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:23.961645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:23.962067 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:24.175288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:24.183662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ee82c7c9-056c-49ca-a411-70a83ce5156f tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.235199 Aug 08 00:39:24.184521 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 420/842] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:23 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:24.196065 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:24.196828 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:24.202782 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:24.204307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:24.204307 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:24.204669 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:24.204825 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:24.205251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:24.219118 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 HTTP/1.1 Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:39:24.220819 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:39:24.222393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '1c80c22a-1596-4b59-a033-7c82163e2b00'} Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:39:24.223217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:39:24.224696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:24.227058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:39:24.227058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-628dc01d-b1d8-4b7d-bccb-b78c4d710177 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 404 len: 111 microversion: 2.1 time: 0.029915 Aug 08 00:39:24.227058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 421/843] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:24 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:39:24.238796 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3fe77dd2-37c2-4c38-a98a-a2a4a8958f9f tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '.version_select at 0x7fd1a1ed0e50>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:24.246217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a6ba4ad5-1e56-4560-94d5-adc9c4c439da tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.153860 Aug 08 00:39:24.246866 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 423/844] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:39:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:39:24.257693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-35d71de5-c249-428c-acfb-dfc0f5a5cc38 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:24.258301 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-35d71de5-c249-428c-acfb-dfc0f5a5cc38 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:24.314125 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-35d71de5-c249-428c-acfb-dfc0f5a5cc38 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:24.316575 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3fe77dd2-37c2-4c38-a98a-a2a4a8958f9f tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262890952" status: 202 len: 0 microversion: 2.1 time: 0.088242 Aug 08 00:39:24.317726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 422/845] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 8 00:39:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262890952 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:39:24.322234 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-35d71de5-c249-428c-acfb-dfc0f5a5cc38 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1093 microversion: 2.1 time: 0.068434 Aug 08 00:39:24.322810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 424/846] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:24 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:24.920677 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:24.921284 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:24.931131 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:24.931651 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:24.934426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:24.934426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:24.934426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:24.934426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:25.068229 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:25.081532 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-27062009-9d55-49ef-852e-48a84048fb33 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.164615 Aug 08 00:39:25.082116 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 423/847] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:24 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:25.135133 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9afa44a6-4781-4f44-acd3-72fe90dee4c1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: .version_select at 0x7fd1a1e98310>, body: {"keypair": {"name": "tempest-keypair-180440968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaAPtsOtJv5tIIY5bBCl4EDeWVlyIjWwmwruD9Y92K3hvp6MEVvTaX69/Q8uUUI/k7DQvPGqwGFHG0DwE01o7svFL+YjiAfNV28C12YXvx+5P+hiwVIghDknupzDB+csg=="}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:25.151833 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-9afa44a6-4781-4f44-acd3-72fe90dee4c1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for project e97eb34021d44eb0a99763034c1e9e87. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:39:25.156050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-9afa44a6-4781-4f44-acd3-72fe90dee4c1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for user 7b317f585f8a4da3abe24ab5cf4ee0c0 and project e97eb34021d44eb0a99763034c1e9e87. Resources: {'key_pairs'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:39:25.205429 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:25.206042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:25.213118 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:25.213608 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:25.214039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:25.214734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:25.215193 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:25.215681 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:25.248107 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9afa44a6-4781-4f44-acd3-72fe90dee4c1 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116805 Aug 08 00:39:25.249400 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 425/848] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:39:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:25.345426 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:25.346406 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:25.354182 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:25.354671 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:25.355112 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:25.355887 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:25.356345 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:25.356771 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:25.432451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:25.445543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d94c367a-e176-4b0f-b341-d5f69fb0ffb9 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1143 microversion: 2.1 time: 0.104473 Aug 08 00:39:25.446767 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 426/849] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:25 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1143 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:25.617255 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:25.624918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-690d5cd9-4a0a-4b52-baa3-076ce79cf7c7 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.423352 Aug 08 00:39:25.625494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 424/850] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:25 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:26.103246 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:26.103857 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:26.109797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:26.110281 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:26.110713 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:26.111442 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:26.111896 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:26.112320 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:26.264015 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:26.272631 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a54514e7-9404-49ed-be24-af166efe2690 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.172878 Aug 08 00:39:26.283966 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 427/851] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:26 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:26.467170 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:26.479501 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:26.479501 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:26.479501 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:26.479501 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:26.479838 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:26.479838 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:26.479838 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:26.606280 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:26.614037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d52c1bd0-fe91-4724-a281-3ee4bccb6cc1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1199 microversion: 2.1 time: 0.151144 Aug 08 00:39:26.614610 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 425/852] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:26 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1199 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:26.652313 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:26.652313 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:26.663088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:26.663088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:26.663088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:26.663088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:26.663479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:26.663479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:26.811112 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-5e22e14d-3f36-4526-a84d-5fecc63b4554 req-bf0fef83-c532-4e1c-bdac-ba8fae6ceb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd7eaeb-e187-4f41-b379-f063843b6490", "name": "network-vif-plugged", "status": "completed", "tag": "2911615a-80a4-48f6-87fc-1535c284a643"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:26.823757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-5e22e14d-3f36-4526-a84d-5fecc63b4554 req-bf0fef83-c532-4e1c-bdac-ba8fae6ceb82 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:26.824236 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-5e22e14d-3f36-4526-a84d-5fecc63b4554 req-bf0fef83-c532-4e1c-bdac-ba8fae6ceb82 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:26.824879 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-5e22e14d-3f36-4526-a84d-5fecc63b4554 req-bf0fef83-c532-4e1c-bdac-ba8fae6ceb82 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:26.842216 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-5e22e14d-3f36-4526-a84d-5fecc63b4554 req-bf0fef83-c532-4e1c-bdac-ba8fae6ceb82 service nova] Creating event network-vif-plugged:2911615a-80a4-48f6-87fc-1535c284a643 for instance dbd7eaeb-e187-4f41-b379-f063843b6490 on hv-cinder-85164 Aug 08 00:39:26.844748 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-5e22e14d-3f36-4526-a84d-5fecc63b4554 req-bf0fef83-c532-4e1c-bdac-ba8fae6ceb82 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036920 Aug 08 00:39:26.844968 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:26.845821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 426/853] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:26.854122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f2e268ae-6a79-4bfb-a8e5-99e6e6bb8e25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.211961 Aug 08 00:39:26.854925 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 428/854] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:26 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:27.300739 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:27.301442 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:27.306044 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:27.310264 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:27.311021 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:27.311681 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:27.312640 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:27.313288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:27.314080 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:27.472210 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:27.489406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ef522667-9990-49d9-98b8-4bf1401bc5dc tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.184548 Aug 08 00:39:27.489406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 427/855] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:27 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:27.640279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:27.640745 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:27.648802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:27.649298 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:27.649745 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:27.650481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:27.650938 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:27.651397 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:27.686358 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-37906069", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5ea35fc-5529-4ec7-b035-b5f2637c5acc"}], "security_groups": [{"name": "tempest-securitygroup--499244625"}], "key_name": "tempest-keypair-180440968", "user_data": "}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:27.807317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:27.815271 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c2f7b018-d26e-466f-a947-3c3637eabfd6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1276 microversion: 2.1 time: 0.178928 Aug 08 00:39:27.815843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 429/856] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:27 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:27.868093 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] validate_networks() for [('a5ea35fc-5529-4ec7-b035-b5f2637c5acc', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:39:27.874245 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:27.874856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:27.880822 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:27.882104 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:27.882683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:27.883417 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:27.883875 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:27.884360 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:28.015091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:28.024178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fe05c1f4-5912-4123-a753-bc9093cb80e1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1314 microversion: 2.1 time: 0.153620 Aug 08 00:39:28.024768 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 430/857] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:27 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:28.502261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:28.502865 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:28.508946 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:28.509428 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:28.509856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:28.510547 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:28.510998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:28.511447 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:28.515563 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:28.554375 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:39:28.554914 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:39:28.555290 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:39:28.555693 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:39:28.556096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:39:28.564811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:28.566524 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:28.566524 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:28.566524 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:28.566847 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:28.567477 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:28.584686 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for project e97eb34021d44eb0a99763034c1e9e87. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:39:28.588654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Getting quotas for user 7b317f585f8a4da3abe24ab5cf4ee0c0 and project e97eb34021d44eb0a99763034c1e9e87. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:39:28.600883 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:39:28.603468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:39:28.658381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:28.670969 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c90de424-19a1-4a57-ad0d-92bde94c9332 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.168133 Aug 08 00:39:28.670969 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 431/858] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:28 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:28.672453 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-8501780d-f4ed-4af5-8187-9c01277a5693 req-84f34aef-722e-4b51-a630-fab29eb96de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89abab5-8e69-4485-be7a-d76eb57f16a5", "tag": "e6fc7acc-6a32-4ac7-91cb-f76468a453aa"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:28.682682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8501780d-f4ed-4af5-8187-9c01277a5693 req-84f34aef-722e-4b51-a630-fab29eb96de9 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:28.683163 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8501780d-f4ed-4af5-8187-9c01277a5693 req-84f34aef-722e-4b51-a630-fab29eb96de9 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:28.683632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8501780d-f4ed-4af5-8187-9c01277a5693 req-84f34aef-722e-4b51-a630-fab29eb96de9 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:28.698288 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-8501780d-f4ed-4af5-8187-9c01277a5693 req-84f34aef-722e-4b51-a630-fab29eb96de9 service nova] Creating event network-changed:e6fc7acc-6a32-4ac7-91cb-f76468a453aa for instance b89abab5-8e69-4485-be7a-d76eb57f16a5 on hv-cinder-85164 Aug 08 00:39:28.706071 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-8501780d-f4ed-4af5-8187-9c01277a5693 req-84f34aef-722e-4b51-a630-fab29eb96de9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036925 Aug 08 00:39:28.712187 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 432/859] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:28.721049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1dbb28e2-401e-43bf-845c-f66e65da2483 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.039220 Aug 08 00:39:28.721854 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 428/860] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:39:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:39:28.733598 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-34d1af5a-a806-4594-a132-5f0464692f7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:28.734469 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-34d1af5a-a806-4594-a132-5f0464692f7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:28.808214 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-34d1af5a-a806-4594-a132-5f0464692f7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:28.815385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-34d1af5a-a806-4594-a132-5f0464692f7b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1239 microversion: 2.1 time: 0.085932 Aug 08 00:39:28.816610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 433/861] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:28 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:28.845847 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:28.846582 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:28.858330 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:28.858872 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:28.859352 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:28.860073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:28.860569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:28.861167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:29.045795 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:29.046403 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:29.052875 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:29.053576 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:29.054857 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:29.055880 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:29.056484 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:29.057066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:29.076332 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:29.085498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9b54e229-dc59-41e5-909f-b50985be3606 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.247070 Aug 08 00:39:29.089858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 429/862] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:28 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:29.195588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:29.203404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e2e7186e-ea20-48f2-8000-14b17b36a8a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1497 microversion: 2.1 time: 0.161423 Aug 08 00:39:29.204224 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 434/863] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:29 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:29.689480 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:29.690090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:29.699208 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:29.699208 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:29.699208 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:29.699526 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:29.699789 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:29.700324 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:29.834321 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:29.842733 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1599af59-596b-43e4-ac4e-679a7c5a80d2 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.158054 Aug 08 00:39:29.843332 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 430/864] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:29 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:29.845254 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:29.845907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:29.852479 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:29.852974 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:29.853417 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:29.854122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:29.854611 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:29.855044 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:29.921129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:29.929662 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9bdc40c1-6714-4982-b320-32ca27311988 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1243 microversion: 2.1 time: 0.089315 Aug 08 00:39:29.930225 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 435/865] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:29 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:30.106312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:30.110289 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:30.112894 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.113379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.113891 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:30.114489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.114939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.116209 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:30.149268 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:30.149845 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:30.155914 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.156468 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.156964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:30.157728 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.158270 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.158759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:30.186669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:39:30.253906 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:30.261856 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0d7f0de3-2697-406a-9f5d-47b3d91fa6d8 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.159375 Aug 08 00:39:30.262430 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 431/866] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:30 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:30.473979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-336a5916-44e2-44f2-b61c-09f3f9316583 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 204 len: 0 microversion: 2.1 time: 0.328427 Aug 08 00:39:30.474492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 436/867] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:39:30 2022] DELETE /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 00:39:30.483216 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:30.483892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:30.489821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.490385 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.490858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:30.491568 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.492015 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.492433 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:30.624661 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:30.632436 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a4942b07-ee2c-4947-83ab-ac2b4a0e8806 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1503 microversion: 2.1 time: 0.153039 Aug 08 00:39:30.633012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 432/868] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:30 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:30.864444 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:30.865168 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:30.871671 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.872147 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.872575 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:30.873261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.873710 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.874127 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:30.950903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:30.951645 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:30.958689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.960238 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.960686 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:30.961398 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:30.961849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:30.962272 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:31.029632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:31.037603 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f1d6d5ce-e618-42b2-ab56-934462183d25 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1235 microversion: 2.1 time: 0.090746 Aug 08 00:39:31.038302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 433/869] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:30 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:31.258043 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:31.265610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-48c9d399-d8e7-4ad7-b2a5-7294168c00c4 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.405466 Aug 08 00:39:31.266189 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 437/870] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:30 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:31.282111 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:31.282968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:31.289448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:31.289945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:31.290401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:31.291122 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:31.291612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:31.292039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:31.424106 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:31.431778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1f357a57-675d-4cab-b247-282a66ff6879 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.153609 Aug 08 00:39:31.432350 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 434/871] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:31 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:31.653636 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:31.654250 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:31.657769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:31.661444 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:31.661928 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:31.662783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:31.663523 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:31.663980 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:31.664409 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:31.795129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:31.803416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0e0b7337-c3b9-4c3b-9c3b-3ac0beae2420 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1503 microversion: 2.1 time: 0.153003 Aug 08 00:39:31.803987 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 438/872] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:31 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:32.058510 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:32.059032 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:32.065914 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:32.066449 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:32.066876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:32.067623 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:32.068067 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:32.069149 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:32.134807 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:32.142612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0feb0352-f780-485b-8ba7-d334ef384732 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1291 microversion: 2.1 time: 0.088093 Aug 08 00:39:32.143182 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 435/873] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:32 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1291 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:32.286703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:32.287834 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:32.294282 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:32.294769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:32.295253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:32.295961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:32.296419 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:32.296847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:32.427506 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:32.435640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-31ca98d0-8483-4e79-8f74-e5931cca61c9 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.152757 Aug 08 00:39:32.436200 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 439/874] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:32 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:32.452824 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:32.453644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:32.460228 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:32.460792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:32.461292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:32.462087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:32.462703 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:32.463204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:32.721311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:32.732216 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6b77c517-85ba-4383-93fa-d588011f7bd7 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.283798 Aug 08 00:39:32.733710 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 436/875] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:32 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:32.825588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:32.826202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:32.832318 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:32.832807 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:32.833253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:32.834603 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:32.835370 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:32.835811 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:33.041455 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:33.049985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4c6bd5c2-1fd8-400d-ad97-6f8cc1121dd6 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1503 microversion: 2.1 time: 0.228097 Aug 08 00:39:33.050957 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 440/876] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:32 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:33.112146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-fd1373ed-f5cb-47fc-9a08-b9101c3d0d3b req-3aa874c8-4453-48d3-89e1-c42b27072448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd7eaeb-e187-4f41-b379-f063843b6490", "name": "network-vif-deleted", "tag": "2911615a-80a4-48f6-87fc-1535c284a643"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:33.128490 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-fd1373ed-f5cb-47fc-9a08-b9101c3d0d3b req-3aa874c8-4453-48d3-89e1-c42b27072448 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:33.128490 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-fd1373ed-f5cb-47fc-9a08-b9101c3d0d3b req-3aa874c8-4453-48d3-89e1-c42b27072448 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:33.128759 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-fd1373ed-f5cb-47fc-9a08-b9101c3d0d3b req-3aa874c8-4453-48d3-89e1-c42b27072448 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:33.140989 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-fd1373ed-f5cb-47fc-9a08-b9101c3d0d3b req-3aa874c8-4453-48d3-89e1-c42b27072448 service nova] Creating event network-vif-deleted:2911615a-80a4-48f6-87fc-1535c284a643 for instance dbd7eaeb-e187-4f41-b379-f063843b6490 on hv-cinder-85164 Aug 08 00:39:33.146006 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-fd1373ed-f5cb-47fc-9a08-b9101c3d0d3b req-3aa874c8-4453-48d3-89e1-c42b27072448 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037441 Aug 08 00:39:33.147011 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 437/877] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:33.165566 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:33.166277 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:33.173718 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:33.174669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:33.175171 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:33.176980 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:33.177437 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:33.179912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:33.281666 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:33.295348 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-efe899ae-2797-42a3-b69c-f3089820b226 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1297 microversion: 2.1 time: 0.135267 Aug 08 00:39:33.297117 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 441/878] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:33 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1297 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:33.457066 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:33.457790 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:33.464454 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:33.464939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:33.465366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:33.466214 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:33.466555 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:33.466969 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:33.606393 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:33.629251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-761f3414-24b2-49f8-80ca-10754be9af9f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.163445 Aug 08 00:39:33.629251 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 438/879] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:33 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:33.754224 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:33.754943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:33.757917 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:33.763179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:33.764022 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:33.764628 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:33.765528 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:33.766180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:33.766818 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:33.960176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:33.967828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-191d73dd-f1f5-4b0d-9c80-3576d69633ab tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.217756 Aug 08 00:39:33.968396 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 442/880] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:33 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:34.072147 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:34.072770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:34.078795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.079313 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.079754 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.080459 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.080942 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.081367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.101344 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=100 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:34.114604 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.115276 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.115571 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.116015 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lazy-loading 'fault' on Instance uuid dbd7eaeb-e187-4f41-b379-f063843b6490 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:39:34.161255 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:34.169283 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-303aedb7-7157-42f6-b83c-afab47b5d856 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 200 len: 1304 microversion: 2.1 time: 0.101110 Aug 08 00:39:34.169856 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 439/881] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:34 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:34.316300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:34.317193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:34.324902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.325550 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.326118 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.326924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.327783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.328331 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.531450 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:34.539543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-54267dbb-592e-4b70-88dd-7058fc1a75f0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.227221 Aug 08 00:39:34.540131 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 443/882] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:34 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:34.640224 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:34.640837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:34.647716 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.648465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.649069 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.649784 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.650282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.650882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.710141 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-e5383c73-4b53-4a54-b578-6fa4232b0b02 req-6ee41a45-f5e3-48cf-8f8f-cfb1888d30b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7fafce-9b1b-4bb2-91a8-8230aa090306", "tag": "2ac4078a-6ecb-482c-989a-86eba88e3b88"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:34.721416 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-e5383c73-4b53-4a54-b578-6fa4232b0b02 req-6ee41a45-f5e3-48cf-8f8f-cfb1888d30b3 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.722114 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-e5383c73-4b53-4a54-b578-6fa4232b0b02 req-6ee41a45-f5e3-48cf-8f8f-cfb1888d30b3 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.722704 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-e5383c73-4b53-4a54-b578-6fa4232b0b02 req-6ee41a45-f5e3-48cf-8f8f-cfb1888d30b3 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.735734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-e5383c73-4b53-4a54-b578-6fa4232b0b02 req-6ee41a45-f5e3-48cf-8f8f-cfb1888d30b3 service nova] Creating event network-changed:2ac4078a-6ecb-482c-989a-86eba88e3b88 for instance db7fafce-9b1b-4bb2-91a8-8230aa090306 on hv-cinder-85164 Aug 08 00:39:34.742434 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-e5383c73-4b53-4a54-b578-6fa4232b0b02 req-6ee41a45-f5e3-48cf-8f8f-cfb1888d30b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037161 Aug 08 00:39:34.746106 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 444/883] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:39:34.757730 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-bfc3e57b-cca4-4cc5-bf67-98b9a1f05197 req-b2052b39-35d3-462d-adbd-742ea69b81a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39cb5181-8bc2-4e47-ab31-1f9524d47ef3", "name": "network-vif-plugged", "status": "completed", "tag": "1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:34.777599 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-bfc3e57b-cca4-4cc5-bf67-98b9a1f05197 req-b2052b39-35d3-462d-adbd-742ea69b81a4 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.778213 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-bfc3e57b-cca4-4cc5-bf67-98b9a1f05197 req-b2052b39-35d3-462d-adbd-742ea69b81a4 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.778906 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-bfc3e57b-cca4-4cc5-bf67-98b9a1f05197 req-b2052b39-35d3-462d-adbd-742ea69b81a4 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.792552 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-bfc3e57b-cca4-4cc5-bf67-98b9a1f05197 req-b2052b39-35d3-462d-adbd-742ea69b81a4 service nova] Creating event network-vif-plugged:1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0 for instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 on hv-cinder-85164 Aug 08 00:39:34.798056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-bfc3e57b-cca4-4cc5-bf67-98b9a1f05197 req-b2052b39-35d3-462d-adbd-742ea69b81a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046805 Aug 08 00:39:34.801847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 445/884] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:39:34.821568 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:34.833180 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f8938591-31b8-402a-a1df-d44c4f02f22b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.196851 Aug 08 00:39:34.833796 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 440/885] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:34 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:34.989829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:34.990963 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:34.998878 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.998878 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:34.998878 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:34.999375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:34.999823 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:35.000249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:35.191015 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:35.191654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: dbd7eaeb-e187-4f41-b379-f063843b6490] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:35.198734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:35.199261 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:35.199687 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:35.200402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:35.200855 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:35.201283 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:35.202356 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:35.211218 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ccf1bb5e-76a4-4a00-8e67-033a65758556 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.224635 Aug 08 00:39:35.211819 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 446/886] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:34 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:35.215523 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] HTTP exception thrown: Instance dbd7eaeb-e187-4f41-b379-f063843b6490 could not be found. Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Request method failure captured: Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 HTTP/1.1 Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FsjCWjFQnDf7D4CeBcQJThEMDPk6rn9_XWqnQi36WiVUPiPTuSqOpwktAcSpp_88WobDduonZxGzkNAoUOjqpHmZkgWCyVPdJNY1Gtd2K3g_oLAvEMr9sqfE6pxYMqCugeNadHMVD2HZvDtAubLrhfWzVKeC-4zQ-LuktHT_tmcNcI Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 2aabdf53ddce4b91a70bdb6a287cb765 Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesActionsTest-1286931498 Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:39:35.217181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2aabdf53ddce4b91a70bdb6a287cb765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2aabdf53ddce4b91a70bdb6a287cb765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2aabdf53ddce4b91a70bdb6a287cb765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2aabdf53ddce4b91a70bdb6a287cb765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesActionsTest-1286931498 Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 2aabdf53ddce4b91a70bdb6a287cb765 Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesActionsTest-1286931498 Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesActionsTest-1286931498-project Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 0a96c63741ad44bf946ba40b6e16d793 Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesActionsTest-1286931498-project Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance dbd7eaeb-e187-4f41-b379-f063843b6490 could not be found. Aug 08 00:39:35.223362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'dbd7eaeb-e187-4f41-b379-f063843b6490'} Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd7eaeb-e187-4f41-b379-f063843b6490 could not be found. Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:39:35.224312 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd7eaeb-e187-4f41-b379-f063843b6490 could not be found. Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd7eaeb-e187-4f41-b379-f063843b6490 could not be found. Aug 08 00:39:35.226502 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:35.227833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Returning 404 to user: Instance dbd7eaeb-e187-4f41-b379-f063843b6490 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:39:35.227833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0dcedf9c-0a6b-4057-915c-44a8ec2261ee tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490" status: 404 len: 111 microversion: 2.1 time: 0.031494 Aug 08 00:39:35.227833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 441/887] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:35 2022] GET /compute/v2.1/servers/dbd7eaeb-e187-4f41-b379-f063843b6490 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:39:35.272498 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1508859369", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "networks": [{"uuid": "5d335768-2822-40df-af2e-ce286fc9bfdf"}]}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:35.325431 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] validate_networks() for [('5d335768-2822-40df-af2e-ce286fc9bfdf', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:39:35.560023 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:35.560637 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:35.566617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:35.567096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:35.567595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:35.568292 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:35.569295 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:35.570141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:35.708089 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:35.717085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-61cc94ec-9bb4-40c3-b72e-3d490e22f0a2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.160836 Aug 08 00:39:35.717831 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 442/888] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:35 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:35.780456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:39:35.780887 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:39:35.781363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:39:35.781769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:39:35.782179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:39:35.790830 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:35.791350 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:35.791779 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:35.792497 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:35.792947 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:35.793367 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:35.810204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Getting quotas for project 2aabdf53ddce4b91a70bdb6a287cb765. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:39:35.814144 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Getting quotas for user 0a96c63741ad44bf946ba40b6e16d793 and project 2aabdf53ddce4b91a70bdb6a287cb765. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:39:35.825814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:39:35.828081 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:39:35.853863 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:35.854469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:35.860315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:35.860795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:35.861228 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:35.861912 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:35.862364 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:35.862789 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:35.980827 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0b45175f-f819-4dcd-9ae7-12749be6ed40 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712365 Aug 08 00:39:35.981624 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 447/889] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:39:35.996563 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-72686251-5ec9-4a63-b4cb-aadf847c4196 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:35.996563 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-72686251-5ec9-4a63-b4cb-aadf847c4196 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:35.996799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:36.005215 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1e480566-9c0e-4739-9e44-f84391eb7f9c tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1573 microversion: 2.1 time: 0.155145 Aug 08 00:39:36.005875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 443/890] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:35 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:36.062775 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-72686251-5ec9-4a63-b4cb-aadf847c4196 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:36.069568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-72686251-5ec9-4a63-b4cb-aadf847c4196 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1214 microversion: 2.1 time: 0.080796 Aug 08 00:39:36.070157 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 448/891] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:35 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:36.231751 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:36.232362 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:36.238801 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:36.239309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:36.239747 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:36.241134 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:36.241494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:36.241918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:36.390609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:36.399566 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d5406678-41cb-498e-9c6a-94007ebf8a59 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.171691 Aug 08 00:39:36.400233 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 444/892] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:36 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:36.737892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:36.738506 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:36.745765 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:36.746249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:36.746683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:36.747413 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:36.747866 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:36.748291 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:36.889404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:36.897051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2cd9cd22-bcd4-4ac9-a8d8-ca3f70afd534 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.162788 Aug 08 00:39:36.897622 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 449/893] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:36 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:37.026012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:37.026617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:37.032589 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:37.033067 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:37.033496 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:37.034176 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:37.034624 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:37.035062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:37.091041 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:37.091676 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:37.097549 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:37.098030 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:37.098470 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:37.099161 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:37.099681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:37.100640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:37.169305 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:37.173158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:37.175212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:37.177636 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-722c41eb-c986-4713-9842-79e4ebbd7482 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1218 microversion: 2.1 time: 0.090424 Aug 08 00:39:37.178506 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 450/894] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:37 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:37.195605 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-cf1ca1c6-f4ea-4a21-bb5c-38741b73e58b tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1560 microversion: 2.1 time: 0.173423 Aug 08 00:39:37.197606 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 445/895] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:37 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:37.421206 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:37.421727 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:37.428539 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:37.429012 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:37.429446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:37.430125 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:37.430573 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:37.431051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:37.561299 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:37.569021 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c7a9c109-9007-4fc9-acfa-305dc12bcc12 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.151665 Aug 08 00:39:37.570052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 451/896] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:37 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:37.918378 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:37.918995 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:37.925810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:37.925984 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:37.926441 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:37.927127 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:37.927656 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:37.928049 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:38.058770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:38.066243 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3c93edf6-e3a1-4990-a7df-c93d26bbd31e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.151793 Aug 08 00:39:38.066807 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 446/897] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:37 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:38.200932 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:38.201590 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:38.208048 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:38.208542 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:38.209279 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:38.210486 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:38.210934 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:38.211380 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:38.273597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:38.281115 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e368fe1d-c9d3-4509-9268-05133958b969 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1210 microversion: 2.1 time: 0.084063 Aug 08 00:39:38.281687 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 452/898] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:38 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:38.590522 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:38.591040 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:38.592916 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:38.595935 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:38.599472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:38.600280 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:38.600729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:38.601429 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:38.601881 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:38.602304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:38.753585 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:38.761950 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b953c30d-470d-4db4-b56c-0982b0ae80ac tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.175372 Aug 08 00:39:38.762538 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 447/899] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:38 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:39.088087 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:39.088689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:39.094661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:39.095138 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:39.095632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:39.096329 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:39.096779 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:39.097197 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:39.240394 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:39.248001 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6ed9d116-3f88-4ed2-919c-985c11cf18ec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.164768 Aug 08 00:39:39.248904 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 453/900] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:39 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:39.303576 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:39.304521 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:39.312026 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:39.312812 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:39.313721 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:39.314876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:39.315601 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:39.316327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:39.387910 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:39.395918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f3780c62-09f9-477f-b7bd-ef066a86e699 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1272 microversion: 2.1 time: 0.097054 Aug 08 00:39:39.397288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 448/901] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:39 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:39.787368 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:39.788294 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:39.794255 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:39.794781 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:39.795250 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:39.795942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:39.796623 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:39.797407 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:40.000450 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:40.008521 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9be7579c-8834-40d4-82f4-0f556cad72ca tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.225127 Aug 08 00:39:40.009092 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 454/902] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:39 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:40.269163 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:40.269768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:40.276130 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:40.276724 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:40.277156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:40.277856 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:40.278298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:40.278713 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:40.417990 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:40.419377 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:40.419991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:40.427733 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:40.428518 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7fa1d37d-7a4a-496b-8e2f-6ba2b9bed367 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.163070 Aug 08 00:39:40.428860 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:40.429417 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 449/903] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:40 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:40.429649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:40.430597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:40.431586 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:40.432163 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:40.624463 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:40.633797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ecd7a78f-76a4-40ee-ac16-d5ef23682e59 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1314 microversion: 2.1 time: 0.218207 Aug 08 00:39:40.634678 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 455/904] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:40 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:40.875774 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-0f568d04-d0d2-4e1a-94b4-0e059b405d00 req-2d35dc45-2696-4e45-95fd-9208b10925b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3c9839-2545-4c90-9229-804f97aa1e9f", "tag": "bad74832-098c-431c-bc63-6279c31b6873"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:40.887578 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-0f568d04-d0d2-4e1a-94b4-0e059b405d00 req-2d35dc45-2696-4e45-95fd-9208b10925b2 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:40.888058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-0f568d04-d0d2-4e1a-94b4-0e059b405d00 req-2d35dc45-2696-4e45-95fd-9208b10925b2 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:40.888692 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-0f568d04-d0d2-4e1a-94b4-0e059b405d00 req-2d35dc45-2696-4e45-95fd-9208b10925b2 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:40.900540 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-0f568d04-d0d2-4e1a-94b4-0e059b405d00 req-2d35dc45-2696-4e45-95fd-9208b10925b2 service nova] Creating event network-changed:bad74832-098c-431c-bc63-6279c31b6873 for instance ec3c9839-2545-4c90-9229-804f97aa1e9f on hv-cinder-85164 Aug 08 00:39:40.905832 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-0f568d04-d0d2-4e1a-94b4-0e059b405d00 req-2d35dc45-2696-4e45-95fd-9208b10925b2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035236 Aug 08 00:39:40.913016 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 450/905] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:41.030594 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:41.031180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:41.037932 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:41.040776 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:41.041466 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:41.043060 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:41.043247 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-6741b0bd-002e-4b82-84c3-caa238b1ac7f req-eb3e67ef-9c19-44ad-b6d8-84ef92b36357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89abab5-8e69-4485-be7a-d76eb57f16a5", "name": "network-vif-plugged", "status": "completed", "tag": "e6fc7acc-6a32-4ac7-91cb-f76468a453aa"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:41.044904 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:41.045351 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:41.054795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-6741b0bd-002e-4b82-84c3-caa238b1ac7f req-eb3e67ef-9c19-44ad-b6d8-84ef92b36357 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:41.062470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-6741b0bd-002e-4b82-84c3-caa238b1ac7f req-eb3e67ef-9c19-44ad-b6d8-84ef92b36357 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:41.062470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-6741b0bd-002e-4b82-84c3-caa238b1ac7f req-eb3e67ef-9c19-44ad-b6d8-84ef92b36357 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:41.068951 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-6741b0bd-002e-4b82-84c3-caa238b1ac7f req-eb3e67ef-9c19-44ad-b6d8-84ef92b36357 service nova] Creating event network-vif-plugged:e6fc7acc-6a32-4ac7-91cb-f76468a453aa for instance b89abab5-8e69-4485-be7a-d76eb57f16a5 on hv-cinder-85164 Aug 08 00:39:41.074998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-6741b0bd-002e-4b82-84c3-caa238b1ac7f req-eb3e67ef-9c19-44ad-b6d8-84ef92b36357 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037089 Aug 08 00:39:41.076246 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 451/906] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:41.198472 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:41.224897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-7f6fe9f2-8b78-4782-8063-b306f700f95a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.197693 Aug 08 00:39:41.225487 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 456/907] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:41 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:41.450201 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:41.450900 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:41.458191 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:41.458705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:41.459437 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:41.460146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:41.460595 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:41.461020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:41.603587 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:41.611095 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1189bbae-f5e0-4cb6-a469-b3c98931efec tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.165076 Aug 08 00:39:41.611695 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 452/908] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:41 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:41.656658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:41.657196 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:41.664497 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:41.664973 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:41.665405 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:41.666094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:41.666542 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:41.666964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:41.866686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:41.874360 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d0b4ae36-dfe0-42a4-b800-d6bd1cf1c6af tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1314 microversion: 2.1 time: 0.221583 Aug 08 00:39:41.876454 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 457/909] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:41 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:42.245765 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:42.246293 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:42.252336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:42.252820 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:42.253256 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:42.253949 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:42.254405 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:42.254825 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:42.386615 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:42.394089 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-974aa540-4893-434f-b194-1bf0f4d2b0d3 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1264 microversion: 2.1 time: 0.152399 Aug 08 00:39:42.394643 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 453/910] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:42 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:42.632095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:42.632703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:42.638913 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:42.639426 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:42.639862 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:42.640554 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:42.641004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:42.641424 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:42.897946 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:42.898846 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:42.907103 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:42.911239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:42.911239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:42.911239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:42.911239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:42.911671 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:43.032089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:43.040453 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-68179f08-b98b-4163-acfc-726cdb7cba58 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.412768 Aug 08 00:39:43.048725 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 458/911] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:42 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:43.065609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:43.073313 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fda42ab3-9cf4-4586-a74b-1e8fd28fc4a1 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1314 microversion: 2.1 time: 0.179605 Aug 08 00:39:43.073889 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 454/912] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:42 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:43.093027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-e411b209-dd68-4e58-b143-64e0e3c5a40b req-8b8691e7-e64e-4d9f-bd18-619dfad469de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7fafce-9b1b-4bb2-91a8-8230aa090306", "name": "network-vif-plugged", "status": "completed", "tag": "2ac4078a-6ecb-482c-989a-86eba88e3b88"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:43.103442 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-e411b209-dd68-4e58-b143-64e0e3c5a40b req-8b8691e7-e64e-4d9f-bd18-619dfad469de service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:43.103924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-e411b209-dd68-4e58-b143-64e0e3c5a40b req-8b8691e7-e64e-4d9f-bd18-619dfad469de service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:43.104354 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-e411b209-dd68-4e58-b143-64e0e3c5a40b req-8b8691e7-e64e-4d9f-bd18-619dfad469de service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:43.115163 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-e411b209-dd68-4e58-b143-64e0e3c5a40b req-8b8691e7-e64e-4d9f-bd18-619dfad469de service nova] Creating event network-vif-plugged:2ac4078a-6ecb-482c-989a-86eba88e3b88 for instance db7fafce-9b1b-4bb2-91a8-8230aa090306 on hv-cinder-85164 Aug 08 00:39:43.120136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-e411b209-dd68-4e58-b143-64e0e3c5a40b req-8b8691e7-e64e-4d9f-bd18-619dfad469de service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030767 Aug 08 00:39:43.120710 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 459/913] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:43.414764 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:43.415428 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:43.421402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:43.421883 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:43.422319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:43.423006 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:43.423489 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:43.423912 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:43.556941 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:43.564503 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-811e02af-ef10-4e7d-a6b3-084fa8985929 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1452 microversion: 2.1 time: 0.154439 Aug 08 00:39:43.565078 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 455/914] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:43 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:43.586858 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:43.587588 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:43.593870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:43.594359 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:43.594802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:43.595521 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:43.596000 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:43.596413 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:43.739042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:43.746829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1fadd85a-0ef6-4732-8965-e1900bf451f4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1452 microversion: 2.1 time: 0.164881 Aug 08 00:39:43.747601 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 460/915] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:43 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:44.061855 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:44.062462 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:44.069432 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:44.069923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:44.070340 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:44.071034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:44.071507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:44.078667 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:44.095851 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:44.096590 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:44.103507 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:44.103991 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:44.104423 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:44.105118 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:44.105559 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:44.106165 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:44.208275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:44.216696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f68af791-33c3-40c5-9b1d-d876947e2997 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.158663 Aug 08 00:39:44.218096 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 456/916] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:44 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:44.319543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:44.327376 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-065de2eb-7b20-42ff-8b6d-bcd2e28e39f0 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1314 microversion: 2.1 time: 0.235279 Aug 08 00:39:44.327967 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 461/917] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:44 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:45.238308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:45.238894 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:45.245596 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:45.246321 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:45.247085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:45.247822 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:45.248276 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:45.248699 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:45.348847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:45.349863 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:45.356460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:45.357066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:45.357641 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:45.358446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:45.358992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:45.359677 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:45.391014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:45.394545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=100 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:45.405267 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f30fabc7-7621-4ea3-a900-3242a71a18dd tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1364 microversion: 2.1 time: 0.166497 Aug 08 00:39:45.405267 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 457/918] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:45 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:45.582874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:45.591167 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-970b5721-f33a-4d8f-b351-44118ca42f25 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1314 microversion: 2.1 time: 0.246264 Aug 08 00:39:45.591782 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 462/919] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:45 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:45.861452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-5905b40e-e452-497f-a639-fe854619e8ab req-44291a11-8bf1-4ba3-87be-bb3e40a75722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89abab5-8e69-4485-be7a-d76eb57f16a5", "tag": "e6fc7acc-6a32-4ac7-91cb-f76468a453aa"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:45.872628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-5905b40e-e452-497f-a639-fe854619e8ab req-44291a11-8bf1-4ba3-87be-bb3e40a75722 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:45.873192 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-5905b40e-e452-497f-a639-fe854619e8ab req-44291a11-8bf1-4ba3-87be-bb3e40a75722 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:45.873709 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-5905b40e-e452-497f-a639-fe854619e8ab req-44291a11-8bf1-4ba3-87be-bb3e40a75722 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:45.885826 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-5905b40e-e452-497f-a639-fe854619e8ab req-44291a11-8bf1-4ba3-87be-bb3e40a75722 service nova] Creating event network-changed:e6fc7acc-6a32-4ac7-91cb-f76468a453aa for instance b89abab5-8e69-4485-be7a-d76eb57f16a5 on hv-cinder-85164 Aug 08 00:39:45.891009 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-5905b40e-e452-497f-a639-fe854619e8ab req-44291a11-8bf1-4ba3-87be-bb3e40a75722 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034519 Aug 08 00:39:45.892962 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 458/920] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:46.422118 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:46.422839 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:46.425047 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:46.426030 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=22 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:46.432286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:46.432778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:46.433214 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:46.434137 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:46.434613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:46.435153 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:46.571757 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:46.579328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e7043db0-077a-48d8-b81d-7080f78f6e18 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1555 microversion: 2.1 time: 0.161560 Aug 08 00:39:46.579892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 463/921] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:46 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:46.600850 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-67ef64d7-72f6-4125-96fa-8d58b73440db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:46.601436 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-67ef64d7-72f6-4125-96fa-8d58b73440db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:46.608771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67ef64d7-72f6-4125-96fa-8d58b73440db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:46.609258 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67ef64d7-72f6-4125-96fa-8d58b73440db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:46.609878 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67ef64d7-72f6-4125-96fa-8d58b73440db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:46.610656 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67ef64d7-72f6-4125-96fa-8d58b73440db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:46.611320 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67ef64d7-72f6-4125-96fa-8d58b73440db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:46.611896 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-67ef64d7-72f6-4125-96fa-8d58b73440db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:46.624487 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:46.625100 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:46.634953 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:46.635476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:46.635907 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:46.636601 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:46.637049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:46.637467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:46.717734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-67ef64d7-72f6-4125-96fa-8d58b73440db tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121737 Aug 08 00:39:46.718329 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 459/922] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 00:39:46 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:46.834519 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:46.842955 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-021172b8-6e78-4597-8154-57e0b689e830 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1314 microversion: 2.1 time: 0.228162 Aug 08 00:39:46.843569 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 464/923] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:46 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:46.891904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-23fbe223-e4cf-49a3-b0b5-b9538b99c3c6 req-bffce051-b326-45ea-b287-aca2b3820caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3c9839-2545-4c90-9229-804f97aa1e9f", "name": "network-vif-plugged", "status": "completed", "tag": "bad74832-098c-431c-bc63-6279c31b6873"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:46.901619 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-23fbe223-e4cf-49a3-b0b5-b9538b99c3c6 req-bffce051-b326-45ea-b287-aca2b3820caa service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:46.902094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-23fbe223-e4cf-49a3-b0b5-b9538b99c3c6 req-bffce051-b326-45ea-b287-aca2b3820caa service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:46.902519 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-23fbe223-e4cf-49a3-b0b5-b9538b99c3c6 req-bffce051-b326-45ea-b287-aca2b3820caa service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:46.914101 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-23fbe223-e4cf-49a3-b0b5-b9538b99c3c6 req-bffce051-b326-45ea-b287-aca2b3820caa service nova] Creating event network-vif-plugged:bad74832-098c-431c-bc63-6279c31b6873 for instance ec3c9839-2545-4c90-9229-804f97aa1e9f on hv-cinder-85164 Aug 08 00:39:46.919158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-23fbe223-e4cf-49a3-b0b5-b9538b99c3c6 req-bffce051-b326-45ea-b287-aca2b3820caa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031188 Aug 08 00:39:46.919992 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 460/924] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:47.863967 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:47.864599 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:47.871537 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:47.872017 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:47.872448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:47.873141 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:47.873589 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:47.874010 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:47.981231 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-7d26140f-3526-434c-a233-f33c20920700 req-7b683a78-93ac-4e24-87d4-20bed7b69588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7fafce-9b1b-4bb2-91a8-8230aa090306", "tag": "2ac4078a-6ecb-482c-989a-86eba88e3b88"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:47.991766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-7d26140f-3526-434c-a233-f33c20920700 req-7b683a78-93ac-4e24-87d4-20bed7b69588 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:47.992260 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-7d26140f-3526-434c-a233-f33c20920700 req-7b683a78-93ac-4e24-87d4-20bed7b69588 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:47.992714 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-7d26140f-3526-434c-a233-f33c20920700 req-7b683a78-93ac-4e24-87d4-20bed7b69588 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:48.003912 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-7d26140f-3526-434c-a233-f33c20920700 req-7b683a78-93ac-4e24-87d4-20bed7b69588 service nova] Creating event network-changed:2ac4078a-6ecb-482c-989a-86eba88e3b88 for instance db7fafce-9b1b-4bb2-91a8-8230aa090306 on hv-cinder-85164 Aug 08 00:39:48.012266 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:48.015653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-7d26140f-3526-434c-a233-f33c20920700 req-7b683a78-93ac-4e24-87d4-20bed7b69588 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036643 Aug 08 00:39:48.015653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 461/925] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:39:48.026407 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-7b33a67b-60bb-4b8f-86b2-01b5e8b5b3a3 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1314 microversion: 2.1 time: 0.166140 Aug 08 00:39:48.027006 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 465/926] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:47 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:49.049587 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:49.050468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:49.058942 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:49.059881 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:49.060563 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:49.061699 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:49.062275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:49.062807 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:49.214537 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:49.228175 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a670ed97-73ec-484d-8f96-7dd887ea1847 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1498 microversion: 2.1 time: 0.183125 Aug 08 00:39:49.229177 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 462/927] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:49 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1498 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:50.148199 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:50.148720 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:50.155101 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:50.155615 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:50.156053 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:50.156748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:50.157204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:50.157633 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:50.182562 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:39:50.331423 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:50.508351 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ff0d21ef-f6a5-420e-9b0f-0540e1730a72 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 204 len: 0 microversion: 2.1 time: 0.364169 Aug 08 00:39:50.508950 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 466/928] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:39:50 2022] DELETE /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:39:50.517057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:50.517710 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:50.524820 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:50.525578 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:50.526021 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:50.526714 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:50.527164 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:50.527616 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:50.658696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:50.666774 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-333bcaf5-f5a5-46ad-99dc-e9d44d82a99c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1504 microversion: 2.1 time: 0.153425 Aug 08 00:39:50.667583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 463/929] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:50 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:51.688597 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:51.689287 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:51.695757 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:51.696228 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:51.696657 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:51.697361 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:51.697787 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:51.698683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:51.832737 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:51.841072 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-757c3d06-b459-4172-936c-3c5a259218b9 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1504 microversion: 2.1 time: 0.156652 Aug 08 00:39:51.841627 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 467/930] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:51 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:39:52.639897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-155deb1a-c77b-447d-915c-9045ec63f9c7 req-ed568819-6772-49d4-a250-0b90956d15e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3c9839-2545-4c90-9229-804f97aa1e9f", "name": "network-vif-deleted", "tag": "bad74832-098c-431c-bc63-6279c31b6873"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:39:52.649895 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-155deb1a-c77b-447d-915c-9045ec63f9c7 req-ed568819-6772-49d4-a250-0b90956d15e9 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:52.651294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-155deb1a-c77b-447d-915c-9045ec63f9c7 req-ed568819-6772-49d4-a250-0b90956d15e9 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:52.651294 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-155deb1a-c77b-447d-915c-9045ec63f9c7 req-ed568819-6772-49d4-a250-0b90956d15e9 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:52.663435 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-155deb1a-c77b-447d-915c-9045ec63f9c7 req-ed568819-6772-49d4-a250-0b90956d15e9 service nova] Creating event network-vif-deleted:bad74832-098c-431c-bc63-6279c31b6873 for instance ec3c9839-2545-4c90-9229-804f97aa1e9f on hv-cinder-85164 Aug 08 00:39:52.669008 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-155deb1a-c77b-447d-915c-9045ec63f9c7 req-ed568819-6772-49d4-a250-0b90956d15e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032688 Aug 08 00:39:52.669630 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 464/931] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:39:52.862099 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:52.862720 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:52.869260 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:52.869748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:52.870188 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:52.871041 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:52.871540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:52.871998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:52.938055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a96c63741ad44bf946ba40b6e16d793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aabdf53ddce4b91a70bdb6a287cb765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:52.945668 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-60eae02a-14e0-4e49-8cba-6f80a1ed1b11 tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 200 len: 1299 microversion: 2.1 time: 0.087477 Aug 08 00:39:52.946224 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 468/932] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:52 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:53.966597 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:53.967214 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] [instance: ec3c9839-2545-4c90-9229-804f97aa1e9f] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:53.973875 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:53.974353 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:53.974789 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:53.975520 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:53.975974 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:53.976397 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:53.990657 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] HTTP exception thrown: Instance ec3c9839-2545-4c90-9229-804f97aa1e9f could not be found. Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Request method failure captured: Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f HTTP/1.1 Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FsjCWjFQnDf7D4CeBcQJThEMDPk6rn9_XWqnQi36WiVUPiPTuSqOpwktAcSpp_88WobDduonZxGzkNAoUOjqpHmZkgWCyVPdJNY1Gtd2K3g_oLAvEMr9sqfE6pxYMqCugeNadHMVD2HZvDtAubLrhfWzVKeC-4zQ-LuktHT_tmcNcI Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 2aabdf53ddce4b91a70bdb6a287cb765 Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesActionsTest-1286931498 Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:39:53.992356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2aabdf53ddce4b91a70bdb6a287cb765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2aabdf53ddce4b91a70bdb6a287cb765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2aabdf53ddce4b91a70bdb6a287cb765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2aabdf53ddce4b91a70bdb6a287cb765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesActionsTest-1286931498 Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 2aabdf53ddce4b91a70bdb6a287cb765 Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesActionsTest-1286931498 Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesActionsTest-1286931498-project Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 0a96c63741ad44bf946ba40b6e16d793 Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesActionsTest-1286931498-project Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance ec3c9839-2545-4c90-9229-804f97aa1e9f could not be found. Aug 08 00:39:53.994042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'ec3c9839-2545-4c90-9229-804f97aa1e9f'} Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec3c9839-2545-4c90-9229-804f97aa1e9f could not be found. Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:39:53.994923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3c9839-2545-4c90-9229-804f97aa1e9f could not be found. Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3c9839-2545-4c90-9229-804f97aa1e9f could not be found. Aug 08 00:39:53.997415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:39:53.998868 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] Returning 404 to user: Instance ec3c9839-2545-4c90-9229-804f97aa1e9f could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:39:53.998868 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f90a3c6d-9c5f-4fcc-8769-1c4a946f761c tempest-VolumesActionsTest-1286931498 tempest-VolumesActionsTest-1286931498-project] 10.222.0.15 "GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f" status: 404 len: 111 microversion: 2.1 time: 0.031469 Aug 08 00:39:53.998868 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 465/933] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:39:53 2022] GET /compute/v2.1/servers/ec3c9839-2545-4c90-9229-804f97aa1e9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:39:58.170214 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0d189a57-a522-4305-b659-78a782c9a840 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:58.172496 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0d189a57-a522-4305-b659-78a782c9a840 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:58.179121 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0d189a57-a522-4305-b659-78a782c9a840 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:58.179640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0d189a57-a522-4305-b659-78a782c9a840 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:58.180084 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0d189a57-a522-4305-b659-78a782c9a840 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:58.180783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0d189a57-a522-4305-b659-78a782c9a840 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:58.181242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0d189a57-a522-4305-b659-78a782c9a840 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:58.181670 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0d189a57-a522-4305-b659-78a782c9a840 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:58.212381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0d189a57-a522-4305-b659-78a782c9a840 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046373 Aug 08 00:39:58.213018 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 469/934] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Aug 8 00:39:58 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:39:58.275273 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:58.275934 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:58.282179 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:58.282656 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:58.283083 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:58.283799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:58.284247 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:58.284664 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:58.312120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Going to try to terminate instance {{(pid=130172) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:39:58.540005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:39:58.623762 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a9c6e577-3a19-4e4d-ad35-e03b9cb826e2 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 204 len: 0 microversion: 2.20 time: 0.352251 Aug 08 00:39:58.624546 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 466/935] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 8 00:39:58 2022] DELETE /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 00:39:58.632704 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:58.633305 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:58.639385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:58.639861 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:58.640317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:58.640997 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:58.641439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:58.641856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:58.773994 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:58.782430 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:58.783946 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:58.785094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d7a456ce-83d0-4930-9c0d-1877b7cca7d6 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.156255 Aug 08 00:39:58.785669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 470/936] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:58 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:39:59.810488 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:39:59.811914 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:39:59.819468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:59.819972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:59.820589 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:59.821291 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:39:59.821742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:39:59.822163 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:39:59.979600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:59.990012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:59.991549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:39:59.992726 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a46630e8-cefc-45c5-a643-7f607b6f1c51 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1724 microversion: 2.20 time: 0.187206 Aug 08 00:39:59.993289 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 467/937] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:39:59 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:40:01.017181 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:01.018031 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:01.024611 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:01.025434 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:01.026115 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:01.027585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:01.028305 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:01.028969 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:01.347411 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:01.365996 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:01.368027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:01.369577 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a6545300-469d-4e2f-baf4-0162119a3476 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1657 microversion: 2.20 time: 0.356803 Aug 08 00:40:01.371601 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 471/938] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:40:01 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1657 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:40:01.678494 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-8e9360f7-14db-499b-9e09-c664c8059eda req-a53a6bcb-25e0-4224-b8db-a91be37d4e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf02d3a-b426-4135-a94a-9048d7515184", "name": "network-vif-deleted", "tag": "434deac6-5c7d-4020-9d69-11e8d0ac4767"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:01.698117 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-8e9360f7-14db-499b-9e09-c664c8059eda req-a53a6bcb-25e0-4224-b8db-a91be37d4e0b service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:01.702428 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-8e9360f7-14db-499b-9e09-c664c8059eda req-a53a6bcb-25e0-4224-b8db-a91be37d4e0b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:01.702428 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-8e9360f7-14db-499b-9e09-c664c8059eda req-a53a6bcb-25e0-4224-b8db-a91be37d4e0b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:01.715602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-8e9360f7-14db-499b-9e09-c664c8059eda req-a53a6bcb-25e0-4224-b8db-a91be37d4e0b service nova] Creating event network-vif-deleted:434deac6-5c7d-4020-9d69-11e8d0ac4767 for instance 0cf02d3a-b426-4135-a94a-9048d7515184 on hv-cinder-85164 Aug 08 00:40:01.722583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-8e9360f7-14db-499b-9e09-c664c8059eda req-a53a6bcb-25e0-4224-b8db-a91be37d4e0b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048391 Aug 08 00:40:01.727734 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 468/939] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:02.395891 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:02.396689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:02.400064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:02.406698 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:02.407391 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:02.407899 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:02.408703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:02.409207 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:02.409724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:02.448917 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:02.449402 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:02.449843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:02.450287 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lazy-loading 'fault' on Instance uuid 0cf02d3a-b426-4135-a94a-9048d7515184 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:40:02.493867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:02.503364 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:02.504986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcc8eeb749a5457f98492da99199528c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa84c8a680d49f8be48580c62c18889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:02.506143 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-329ac59b-03e0-4737-abc8-ac42f1a035a1 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 200 len: 1371 microversion: 2.20 time: 0.115630 Aug 08 00:40:02.506961 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 472/940] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:40:02 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 08 00:40:03.530600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:03.532442 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:03.541383 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:03.541887 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:03.543346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:03.544547 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:03.545257 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:03.546065 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:03.562443 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] HTTP exception thrown: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Request method failure captured: Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 HTTP/1.1 Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fme81wXHFy-W2EviIkWXgmZjGitmWnSAuSRxPDFDel2xIi_9l1QXSFD0Oo6b86b4mKIr9brfmY5ZZ0aOqdt-XZYJzK5WDIyn2dQBIYYn3cgXJqge9Ov9w_739LQwtLgIQwqwNBwRTsu_ZMPPs-m2Xn3Q4HnzbQwr1OWGELIDZ8w62s Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:40:03.564174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: fcc8eeb749a5457f98492da99199528c Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:03.565973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '0cf02d3a-b426-4135-a94a-9048d7515184'} Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:03.566833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:03.568109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:03.569264 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Returning 404 to user: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:03.569264 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ffaef1c2-72e1-4da0-95c0-694332d0a2de tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 404 len: 111 microversion: 2.20 time: 0.039493 Aug 08 00:40:03.569264 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 469/941] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:40:03 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 00:40:03.575954 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4b82cfc5-2b4f-4c68-925e-4ff8bafba71e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '.version_select at 0x7fd1a1edb0d0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:03.646927 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4b82cfc5-2b4f-4c68-925e-4ff8bafba71e tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955612419" status: 204 len: 0 microversion: 2.20 time: 0.074898 Aug 08 00:40:03.651157 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 473/942] 10.222.0.15 () {60 vars in 1259 bytes} [Mon Aug 8 00:40:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955612419 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 08 00:40:05.796546 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:05.797110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:05.803516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:05.803989 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:05.804433 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:05.805110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:05.805560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:05.805981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:05.819689 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] HTTP exception thrown: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Request method failure captured: Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 HTTP/1.1 Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fme81wXHFy-W2EviIkWXgmZjGitmWnSAuSRxPDFDel2xIi_9l1QXSFD0Oo6b86b4mKIr9brfmY5ZZ0aOqdt-XZYJzK5WDIyn2dQBIYYn3cgXJqge9Ov9w_739LQwtLgIQwqwNBwRTsu_ZMPPs-m2Xn3Q4HnzbQwr1OWGELIDZ8w62s Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:40:05.821279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: fcc8eeb749a5457f98492da99199528c Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.826649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '0cf02d3a-b426-4135-a94a-9048d7515184'} Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:05.827613 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.829087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.830606 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Returning 404 to user: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:05.830606 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4f6c7402-27ae-4a4d-b9d0-e8b93a0d7f6f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 404 len: 111 microversion: 2.20 time: 0.030174 Aug 08 00:40:05.830606 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 470/943] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 8 00:40:05 2022] DELETE /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 00:40:05.832569 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:05.833185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 0cf02d3a-b426-4135-a94a-9048d7515184] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:05.842616 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:05.843129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:05.843690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:05.844430 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:05.844825 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:05.845253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:05.858852 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] HTTP exception thrown: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Request method failure captured: Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 HTTP/1.1 Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fme81wXHFy-W2EviIkWXgmZjGitmWnSAuSRxPDFDel2xIi_9l1QXSFD0Oo6b86b4mKIr9brfmY5ZZ0aOqdt-XZYJzK5WDIyn2dQBIYYn3cgXJqge9Ov9w_739LQwtLgIQwqwNBwRTsu_ZMPPs-m2Xn3Q4HnzbQwr1OWGELIDZ8w62s Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:40:05.860540 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: fcc8eeb749a5457f98492da99199528c Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.862170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '0cf02d3a-b426-4135-a94a-9048d7515184'} Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:05.863051 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. Aug 08 00:40:05.871375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:05.872681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Returning 404 to user: Instance 0cf02d3a-b426-4135-a94a-9048d7515184 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:05.872681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e4df8d57-6951-477d-89e9-c9e8db75e49f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184" status: 404 len: 111 microversion: 2.20 time: 0.033169 Aug 08 00:40:05.872681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 474/944] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:40:05 2022] GET /compute/v2.1/servers/0cf02d3a-b426-4135-a94a-9048d7515184 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 00:40:07.160285 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:07.160913 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:07.168082 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:07.168461 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:07.169472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:07.170351 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:07.171016 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:07.171658 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:07.187919 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] HTTP exception thrown: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Request method failure captured: Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 HTTP/1.1 Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fme81wXHFy-W2EviIkWXgmZjGitmWnSAuSRxPDFDel2xIi_9l1QXSFD0Oo6b86b4mKIr9brfmY5ZZ0aOqdt-XZYJzK5WDIyn2dQBIYYn3cgXJqge9Ov9w_739LQwtLgIQwqwNBwRTsu_ZMPPs-m2Xn3Q4HnzbQwr1OWGELIDZ8w62s Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:40:07.190097 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: fcc8eeb749a5457f98492da99199528c Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.191839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '4829f58c-adec-413d-83c8-23f1d3143205'} Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:07.192746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.194241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.196610 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Returning 404 to user: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:07.197521 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6a240870-95b1-4ea0-9dc8-100d6fd64b3f tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 404 len: 111 microversion: 2.20 time: 0.041466 Aug 08 00:40:07.198074 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 471/945] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Aug 8 00:40:07 2022] DELETE /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 08 00:40:07.206840 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:07.208064 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] [instance: 4829f58c-adec-413d-83c8-23f1d3143205] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:07.215561 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:07.216330 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:07.217036 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:07.217968 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:07.218618 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:07.219105 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:07.233963 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] HTTP exception thrown: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Request method failure captured: Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 HTTP/1.1 Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fme81wXHFy-W2EviIkWXgmZjGitmWnSAuSRxPDFDel2xIi_9l1QXSFD0Oo6b86b4mKIr9brfmY5ZZ0aOqdt-XZYJzK5WDIyn2dQBIYYn3cgXJqge9Ov9w_739LQwtLgIQwqwNBwRTsu_ZMPPs-m2Xn3Q4HnzbQwr1OWGELIDZ8w62s Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Openstack-Nova-Api-Version: 2.20 Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:40:07.235520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1aa84c8a680d49f8be48580c62c18889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 1aa84c8a680d49f8be48580c62c18889 Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2067061410 Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: fcc8eeb749a5457f98492da99199528c Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2067061410-project Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.237145 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '4829f58c-adec-413d-83c8-23f1d3143205'} Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:07.237942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. Aug 08 00:40:07.239363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:07.240553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] Returning 404 to user: Instance 4829f58c-adec-413d-83c8-23f1d3143205 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:07.240553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9d527197-c424-4ffe-8fb9-713df6002398 tempest-AttachVolumeShelveTestJSON-2067061410 tempest-AttachVolumeShelveTestJSON-2067061410-project] 10.222.0.15 "GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205" status: 404 len: 111 microversion: 2.20 time: 0.034083 Aug 08 00:40:07.241304 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 475/946] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Aug 8 00:40:07 2022] GET /compute/v2.1/servers/4829f58c-adec-413d-83c8-23f1d3143205 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 08 00:40:19.475388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:19.475388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:19.595487 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-09188111-0605-41a9-8e35-9a3bd482271e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'create', calling method: .version_select at 0x7fd1a1f8c4c0>, body: {"keypair": {"name": "tempest-keypair-191832724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBcPe5xcHULelax5k/+Vb4C5bwNoAw5KjYJnZgO8mO8GoGhef33tFxeN8IMF65mnTcRW+vny4R8lGHYDX08wfAdrmQ3mLqvdJgL5KkA0ZRSz3ilF9N5XM3TxDbx2KX3Qw=="}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:19.611368 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-09188111-0605-41a9-8e35-9a3bd482271e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Getting quotas for project 2c27d244bd514766b955d1a4aba239eb. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:40:19.615250 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-09188111-0605-41a9-8e35-9a3bd482271e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Getting quotas for user 1f22b554ae524ccf9a8777ac24cdd688 and project 2c27d244bd514766b955d1a4aba239eb. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:40:19.703829 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-09188111-0605-41a9-8e35-9a3bd482271e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.238826 Aug 08 00:40:19.704472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 472/947] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:40:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:22.077201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1834620036", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1ea4937-9f88-413c-acfe-262c6911cb43"}], "security_groups": [{"name": "tempest-securitygroup--1741696323"}], "key_name": "tempest-keypair-191832724", "user_data": "}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:22.089180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:22.089731 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:22.206387 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] validate_networks() for [('a1ea4937-9f88-413c-acfe-262c6911cb43', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:40:22.629499 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:40:22.629956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:40:22.630439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:40:22.630850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:40:22.631501 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:40:22.642323 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:22.642813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:22.643276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:22.644015 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:22.644468 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:22.644895 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:22.663766 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Getting quotas for project 2c27d244bd514766b955d1a4aba239eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:40:22.670039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Getting quotas for user 1f22b554ae524ccf9a8777ac24cdd688 and project 2c27d244bd514766b955d1a4aba239eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:40:22.682342 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:40:22.685020 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:40:22.837683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c9fc09fd-4a94-4cd1-943d-364e22068b72 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.767846 Aug 08 00:40:22.838532 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 476/948] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:40:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:40:22.859466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6d39050d-7daf-4c8f-a5e0-9caddcdada95 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:22.860747 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6d39050d-7daf-4c8f-a5e0-9caddcdada95 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:22.932335 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6d39050d-7daf-4c8f-a5e0-9caddcdada95 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:22.940537 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6d39050d-7daf-4c8f-a5e0-9caddcdada95 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1237 microversion: 2.1 time: 0.093441 Aug 08 00:40:22.941698 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 473/949] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:22 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:40:23.961547 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:23.962153 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:23.969209 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:23.969681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:23.970108 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:23.970795 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:23.971269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:23.971696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:24.032872 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:24.041606 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5494d485-4321-4c90-848e-3602354d9ff5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1241 microversion: 2.1 time: 0.084510 Aug 08 00:40:24.042185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 477/950] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:23 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:25.062486 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:25.063098 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:25.069624 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:25.070109 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:25.070550 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:25.071263 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:25.071794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:25.072226 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:25.401727 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:25.409159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5ff0375b-7e9c-4f11-8c5f-59a50cfcae20 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1289 microversion: 2.1 time: 0.351091 Aug 08 00:40:25.409724 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 474/951] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:25 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1289 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:26.430739 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:26.431439 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:26.438451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:26.438942 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:26.439430 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:26.440142 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:26.440596 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:26.441342 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:26.646340 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:26.657568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d316dddb-031f-457d-b641-4a99ef1f089a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1363 microversion: 2.1 time: 0.230592 Aug 08 00:40:26.658317 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 478/952] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:26 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:26.884014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-98d946c8-08fe-4ed7-9bd0-8b5a8cf53cec req-ee4fd0c4-cc3d-437f-8d09-9ada5fb13650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62011870-5958-4d03-9ab1-9edb56112d1c", "tag": "4bbb3fd2-65fd-4af3-a645-58300f7aae93"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:26.893992 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-98d946c8-08fe-4ed7-9bd0-8b5a8cf53cec req-ee4fd0c4-cc3d-437f-8d09-9ada5fb13650 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:26.894569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-98d946c8-08fe-4ed7-9bd0-8b5a8cf53cec req-ee4fd0c4-cc3d-437f-8d09-9ada5fb13650 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:26.894957 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-98d946c8-08fe-4ed7-9bd0-8b5a8cf53cec req-ee4fd0c4-cc3d-437f-8d09-9ada5fb13650 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:26.906479 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-98d946c8-08fe-4ed7-9bd0-8b5a8cf53cec req-ee4fd0c4-cc3d-437f-8d09-9ada5fb13650 service nova] Creating event network-changed:4bbb3fd2-65fd-4af3-a645-58300f7aae93 for instance 62011870-5958-4d03-9ab1-9edb56112d1c on hv-cinder-85164 Aug 08 00:40:26.911473 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-98d946c8-08fe-4ed7-9bd0-8b5a8cf53cec req-ee4fd0c4-cc3d-437f-8d09-9ada5fb13650 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031192 Aug 08 00:40:26.912052 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 475/953] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:27.679499 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:27.681658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:27.686928 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:27.687509 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:27.687948 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:27.688659 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:27.689117 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:27.689544 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:27.820355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:27.828650 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d91c9730-b337-47df-a699-5d7ec13e3645 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1363 microversion: 2.1 time: 0.153137 Aug 08 00:40:27.829204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 479/954] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:27 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:28.850843 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:28.851573 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:28.857888 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:28.858374 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:28.858811 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:28.859551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:28.860010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:28.860440 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:28.985174 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-244f32a3-40db-441a-8688-c31716f742ae tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:28.985745 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-244f32a3-40db-441a-8688-c31716f742ae tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:28.990938 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:28.992166 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-244f32a3-40db-441a-8688-c31716f742ae tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:28.992658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-244f32a3-40db-441a-8688-c31716f742ae tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:28.993098 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-244f32a3-40db-441a-8688-c31716f742ae tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:28.993803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-244f32a3-40db-441a-8688-c31716f742ae tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:28.994261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-244f32a3-40db-441a-8688-c31716f742ae tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:28.994690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-244f32a3-40db-441a-8688-c31716f742ae tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:28.999589 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9b8ec8f8-05fd-4e6f-945f-9892dd985512 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1363 microversion: 2.1 time: 0.153301 Aug 08 00:40:29.000170 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 476/955] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:28 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:29.019201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-244f32a3-40db-441a-8688-c31716f742ae tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/ips" status: 200 len: 151 microversion: 2.1 time: 0.038606 Aug 08 00:40:29.019793 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 480/956] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:40:28 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:40:30.020585 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:30.021141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:30.027695 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:30.028174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:30.028607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:30.029288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:30.029735 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:30.030152 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:30.160973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:30.169236 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b95cdeee-56db-4efc-8690-60c2fadb1bd6 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1363 microversion: 2.1 time: 0.152590 Aug 08 00:40:30.169801 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 477/957] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:30 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:30.642503 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-60737885-76a6-4c81-bae8-35ed5717ea16 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07312204-a210-4cf0-8e5f-09e64a3fba44"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:30.644936 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-60737885-76a6-4c81-bae8-35ed5717ea16 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:30.651094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60737885-76a6-4c81-bae8-35ed5717ea16 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:30.651615 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60737885-76a6-4c81-bae8-35ed5717ea16 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:30.652053 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60737885-76a6-4c81-bae8-35ed5717ea16 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:30.653368 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60737885-76a6-4c81-bae8-35ed5717ea16 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:30.653825 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60737885-76a6-4c81-bae8-35ed5717ea16 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:30.654255 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-60737885-76a6-4c81-bae8-35ed5717ea16 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:31.189927 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:31.190535 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:31.196964 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:31.197446 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:31.197894 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:31.198572 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:31.199029 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:31.199482 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:31.334741 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:31.343439 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-27ed02b7-1170-44dc-ab42-86cab0f8d3fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1363 microversion: 2.1 time: 0.157295 Aug 08 00:40:31.343945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 478/958] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:31 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:40:31.386065 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-60737885-76a6-4c81-bae8-35ed5717ea16 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "POST /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747357 Aug 08 00:40:31.387256 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 481/959] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:40:30 2022] POST /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:32.365465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:32.368134 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:32.372892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:32.373369 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:32.373798 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:32.374528 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:32.374978 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:32.375430 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:32.504118 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:32.511518 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-60f86bef-db34-43e0-a9ee-78e85a60f394 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1363 microversion: 2.1 time: 0.150686 Aug 08 00:40:32.512963 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 479/960] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:32 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:33.079765 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-f0dd3cbd-18f3-4aed-abfa-cc4a8ae5707b req-a7887d00-d7cd-4272-8fb0-90e92ab3d106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62011870-5958-4d03-9ab1-9edb56112d1c", "name": "network-vif-plugged", "status": "completed", "tag": "4bbb3fd2-65fd-4af3-a645-58300f7aae93"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:33.085409 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:33.086103 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=6 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:33.091530 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-f0dd3cbd-18f3-4aed-abfa-cc4a8ae5707b req-a7887d00-d7cd-4272-8fb0-90e92ab3d106 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:33.092010 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-f0dd3cbd-18f3-4aed-abfa-cc4a8ae5707b req-a7887d00-d7cd-4272-8fb0-90e92ab3d106 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:33.092465 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-f0dd3cbd-18f3-4aed-abfa-cc4a8ae5707b req-a7887d00-d7cd-4272-8fb0-90e92ab3d106 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:33.103155 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-f0dd3cbd-18f3-4aed-abfa-cc4a8ae5707b req-a7887d00-d7cd-4272-8fb0-90e92ab3d106 service nova] Creating event network-vif-plugged:4bbb3fd2-65fd-4af3-a645-58300f7aae93 for instance 62011870-5958-4d03-9ab1-9edb56112d1c on hv-cinder-85164 Aug 08 00:40:33.108401 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-f0dd3cbd-18f3-4aed-abfa-cc4a8ae5707b req-a7887d00-d7cd-4272-8fb0-90e92ab3d106 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032794 Aug 08 00:40:33.109016 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 482/961] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:33.536061 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:33.536664 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:33.538603 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:33.543867 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:33.544345 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:33.544777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:33.545467 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:33.545915 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:33.546341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:33.679580 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:33.687201 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0732f347-f54b-40c0-97de-2641f2b0cc8a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1363 microversion: 2.1 time: 0.155178 Aug 08 00:40:33.687790 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 480/962] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:33 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:34.709724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:34.710456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:34.718194 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:34.718674 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:34.719107 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:34.719835 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:34.720288 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:34.720712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:34.852811 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:34.861114 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-19dd63b7-c7a9-48da-a6e1-8bc3faadf7a5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1363 microversion: 2.1 time: 0.156363 Aug 08 00:40:34.861672 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 483/963] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:34 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:35.881842 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:35.882484 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:35.889275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:35.889753 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:35.890188 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:35.890877 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:35.891352 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:35.891772 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:36.019069 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:36.026509 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-343d3101-2362-43d5-8b03-9829db79a865 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1548 microversion: 2.1 time: 0.148628 Aug 08 00:40:36.027062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 481/964] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:35 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:36.047037 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-92d2a4c5-707c-4e2a-9acc-5f9f79a0e568 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:36.047602 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-92d2a4c5-707c-4e2a-9acc-5f9f79a0e568 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:36.053981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92d2a4c5-707c-4e2a-9acc-5f9f79a0e568 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:36.054468 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92d2a4c5-707c-4e2a-9acc-5f9f79a0e568 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:36.054903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92d2a4c5-707c-4e2a-9acc-5f9f79a0e568 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:36.055633 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92d2a4c5-707c-4e2a-9acc-5f9f79a0e568 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:36.056099 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92d2a4c5-707c-4e2a-9acc-5f9f79a0e568 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:36.056530 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-92d2a4c5-707c-4e2a-9acc-5f9f79a0e568 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:36.281224 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-92d2a4c5-707c-4e2a-9acc-5f9f79a0e568 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238498 Aug 08 00:40:36.281813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 484/965] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 00:40:36 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/os-interface => generated 284 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:37.301380 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-2042092a-d3b6-4a7f-833e-5443ff052bc1 req-bafce59d-f3c4-4186-8304-0c8a197b12cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62011870-5958-4d03-9ab1-9edb56112d1c", "tag": "4bbb3fd2-65fd-4af3-a645-58300f7aae93"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:37.311580 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2042092a-d3b6-4a7f-833e-5443ff052bc1 req-bafce59d-f3c4-4186-8304-0c8a197b12cd service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:37.313277 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2042092a-d3b6-4a7f-833e-5443ff052bc1 req-bafce59d-f3c4-4186-8304-0c8a197b12cd service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:37.313277 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2042092a-d3b6-4a7f-833e-5443ff052bc1 req-bafce59d-f3c4-4186-8304-0c8a197b12cd service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:37.326891 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-2042092a-d3b6-4a7f-833e-5443ff052bc1 req-bafce59d-f3c4-4186-8304-0c8a197b12cd service nova] Creating event network-changed:4bbb3fd2-65fd-4af3-a645-58300f7aae93 for instance 62011870-5958-4d03-9ab1-9edb56112d1c on hv-cinder-85164 Aug 08 00:40:37.332162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-2042092a-d3b6-4a7f-833e-5443ff052bc1 req-bafce59d-f3c4-4186-8304-0c8a197b12cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034420 Aug 08 00:40:37.333205 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 482/966] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:39.016194 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:39.016740 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:39.022545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:39.023026 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:39.023502 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:39.024193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:39.024647 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:39.025073 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:39.104549 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'services' on Instance uuid db7fafce-9b1b-4bb2-91a8-8230aa090306 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:40:39.342605 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4c639a7b-08fc-4293-a443-c010ce93a0fe tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-volume_attachments/07312204-a210-4cf0-8e5f-09e64a3fba44" status: 202 len: 0 microversion: 2.1 time: 0.330729 Aug 08 00:40:39.343245 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 485/967] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:40:39 2022] DELETE /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-volume_attachments/07312204-a210-4cf0-8e5f-09e64a3fba44 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:40:39.352915 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0ca3f909-8a20-4981-9ff3-1b32e47f4573 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:39.355849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0ca3f909-8a20-4981-9ff3-1b32e47f4573 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:39.362428 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca3f909-8a20-4981-9ff3-1b32e47f4573 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:39.362918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca3f909-8a20-4981-9ff3-1b32e47f4573 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:39.363575 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca3f909-8a20-4981-9ff3-1b32e47f4573 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:39.364327 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca3f909-8a20-4981-9ff3-1b32e47f4573 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:39.364836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca3f909-8a20-4981-9ff3-1b32e47f4573 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:39.365286 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca3f909-8a20-4981-9ff3-1b32e47f4573 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:39.395321 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0ca3f909-8a20-4981-9ff3-1b32e47f4573 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047469 Aug 08 00:40:39.395897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 483/968] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:40:39 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:40.409277 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ddc9835a-e5cb-4b1d-97ad-536ec000182b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:40.411661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ddc9835a-e5cb-4b1d-97ad-536ec000182b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:40.418632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddc9835a-e5cb-4b1d-97ad-536ec000182b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:40.419302 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddc9835a-e5cb-4b1d-97ad-536ec000182b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:40.419791 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddc9835a-e5cb-4b1d-97ad-536ec000182b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:40.420495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddc9835a-e5cb-4b1d-97ad-536ec000182b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:40.420966 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddc9835a-e5cb-4b1d-97ad-536ec000182b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:40.421389 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ddc9835a-e5cb-4b1d-97ad-536ec000182b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:40.456075 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ddc9835a-e5cb-4b1d-97ad-536ec000182b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051596 Aug 08 00:40:40.456647 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 486/969] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:40:40 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 00:40:40.520428 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:40.520916 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:40.527356 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:40.527841 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:40.528279 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:40.528968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:40.529420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:40.529846 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:40.554830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Going to try to terminate instance {{(pid=130172) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:40:40.850748 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c3b0d7bc-4a35-4b3d-ae26-dcb65b8bf924 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 204 len: 0 microversion: 2.1 time: 0.334064 Aug 08 00:40:40.851423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 484/970] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:40:40 2022] DELETE /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:40:40.860490 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:40.861136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:40.867247 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:40.867762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:40.868202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:40.868908 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:40.869449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:40.869881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:41.001404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:41.008831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-711c4def-05ce-45b0-a3ce-7ba9c98a48ed tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1680 microversion: 2.1 time: 0.152288 Aug 08 00:40:41.009385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 487/971] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:40 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:42.030567 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:42.031185 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:42.037635 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:42.038114 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:42.038551 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:42.039266 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:42.039722 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:42.040148 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:42.169946 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:42.177466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-cbb1dad3-82ba-4077-89fb-9df4aad4cd09 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1680 microversion: 2.1 time: 0.151860 Aug 08 00:40:42.178031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 485/972] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:42 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:43.198060 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:43.198638 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:43.206085 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:43.206569 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:43.207109 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:43.207766 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:43.208216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:43.208643 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:43.286799 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:43.294422 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5089a6d4-e651-45b9-90ed-2e8b78a15365 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1613 microversion: 2.1 time: 0.100389 Aug 08 00:40:43.294987 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 488/973] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:43 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:43.510916 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-aad9e54f-7de6-40fa-84cd-3420c49d81ac req-d25b7aee-0d57-4bcd-a792-dcda9574bb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7fafce-9b1b-4bb2-91a8-8230aa090306", "name": "network-vif-deleted", "tag": "2ac4078a-6ecb-482c-989a-86eba88e3b88"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:43.521252 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-aad9e54f-7de6-40fa-84cd-3420c49d81ac req-d25b7aee-0d57-4bcd-a792-dcda9574bb2b service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:43.521733 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-aad9e54f-7de6-40fa-84cd-3420c49d81ac req-d25b7aee-0d57-4bcd-a792-dcda9574bb2b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:43.522169 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-aad9e54f-7de6-40fa-84cd-3420c49d81ac req-d25b7aee-0d57-4bcd-a792-dcda9574bb2b service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:43.533224 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-aad9e54f-7de6-40fa-84cd-3420c49d81ac req-d25b7aee-0d57-4bcd-a792-dcda9574bb2b service nova] Creating event network-vif-deleted:2ac4078a-6ecb-482c-989a-86eba88e3b88 for instance db7fafce-9b1b-4bb2-91a8-8230aa090306 on hv-cinder-85164 Aug 08 00:40:43.538135 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-aad9e54f-7de6-40fa-84cd-3420c49d81ac req-d25b7aee-0d57-4bcd-a792-dcda9574bb2b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030839 Aug 08 00:40:43.538925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 486/974] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:44.316874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:44.318069 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:44.324899 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:44.325388 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:44.325847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:44.326594 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:44.327053 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:44.327508 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:44.365015 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:44.365497 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:44.365924 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:44.366366 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lazy-loading 'fault' on Instance uuid db7fafce-9b1b-4bb2-91a8-8230aa090306 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:40:44.409332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b317f585f8a4da3abe24ab5cf4ee0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97eb34021d44eb0a99763034c1e9e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:40:44.416868 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0a899cad-137a-4242-9612-4d8928bca014 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 200 len: 1329 microversion: 2.1 time: 0.104411 Aug 08 00:40:44.417435 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 489/975] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:44 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 1329 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:40:45.439773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:45.440468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:45.446748 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:45.447308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:45.447672 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:45.448359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:45.448804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:45.449224 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:45.463904 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 HTTP/1.1 Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:40:45.467448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:45.470390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'db7fafce-9b1b-4bb2-91a8-8230aa090306'} Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:45.472162 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:45.474892 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:45.477196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:45.477196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3c0a5ad0-1a11-4609-bba1-f475dc0481b2 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 404 len: 111 microversion: 2.1 time: 0.032673 Aug 08 00:40:45.477196 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 487/976] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:45 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:40:45.479829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-268ab13e-1934-4960-82c8-7e11d54f3ce0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '.version_select at 0x7fd1a1f15dc0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:45.594442 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-268ab13e-1934-4960-82c8-7e11d54f3ce0 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-180440968" status: 202 len: 0 microversion: 2.1 time: 0.120318 Aug 08 00:40:45.595133 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 490/977] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 8 00:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-180440968 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:40:47.580731 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:47.581219 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:47.587874 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:47.588358 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:47.588826 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:47.589517 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:47.589966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:47.590389 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:47.604389 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 HTTP/1.1 Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:40:47.605903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.607549 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'db7fafce-9b1b-4bb2-91a8-8230aa090306'} Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:47.608466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.609967 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.612060 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:47.612060 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8542a701-6db1-4804-a0e9-aad3038240a7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 404 len: 111 microversion: 2.1 time: 0.030411 Aug 08 00:40:47.612060 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 488/978] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:40:47 2022] DELETE /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:40:47.616689 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:47.617327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: db7fafce-9b1b-4bb2-91a8-8230aa090306] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:47.623896 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:47.624369 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:47.624805 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:47.625495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:47.626074 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:47.626511 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:47.639069 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 HTTP/1.1 Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:40:47.640759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.642972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': 'db7fafce-9b1b-4bb2-91a8-8230aa090306'} Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:47.643985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. Aug 08 00:40:47.645476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:47.647025 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance db7fafce-9b1b-4bb2-91a8-8230aa090306 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:47.647025 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a6bb35f2-afc7-4e0c-8641-0a707927ad6b tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306" status: 404 len: 111 microversion: 2.1 time: 0.030437 Aug 08 00:40:47.647025 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 491/979] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:47 2022] GET /compute/v2.1/servers/db7fafce-9b1b-4bb2-91a8-8230aa090306 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:40:48.918037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:48.918646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:48.926025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:48.926448 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:48.926883 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:48.927617 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:48.928071 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:48.928497 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:48.941583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 HTTP/1.1 Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:40:48.943099 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.944773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '1c80c22a-1596-4b59-a033-7c82163e2b00'} Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:48.945701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.947204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.948665 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:48.948665 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2fb7520c-ca90-4db1-a1df-480ea2775644 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 404 len: 111 microversion: 2.1 time: 0.030321 Aug 08 00:40:48.948665 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 489/980] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:40:48 2022] DELETE /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:40:48.952916 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:48.953534 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 1c80c22a-1596-4b59-a033-7c82163e2b00] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:48.960261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:48.960745 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:48.961186 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:48.961875 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:48.962329 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:48.962758 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:48.976225 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 HTTP/1.1 Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:40:48.977754 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.979448 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '1c80c22a-1596-4b59-a033-7c82163e2b00'} Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:48.983151 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. Aug 08 00:40:48.984438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:48.986242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance 1c80c22a-1596-4b59-a033-7c82163e2b00 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:48.986242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f8307351-a34d-42ef-bdba-e3293dc243d3 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00" status: 404 len: 111 microversion: 2.1 time: 0.030025 Aug 08 00:40:48.986242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 492/981] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:48 2022] GET /compute/v2.1/servers/1c80c22a-1596-4b59-a033-7c82163e2b00 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:40:48.988127 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:48.988628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:48.994491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:48.994968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:48.995452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:48.996147 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:48.996602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:48.997028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:49.010262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b HTTP/1.1 Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:40:49.011805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.013515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b'} Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:49.017552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.019062 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.020633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:49.020633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e5e9bb4a-fe1d-48e4-b468-e074d87c90f7 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 404 len: 111 microversion: 2.1 time: 0.029474 Aug 08 00:40:49.020633 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 490/982] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:40:48 2022] DELETE /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:40:49.021724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:49.022342 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:49.028280 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:49.028764 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:49.029201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:49.029895 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:49.030350 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:49.030803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:49.044372 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b HTTP/1.1 Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:40:49.045856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.047543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b'} Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:49.048774 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. Aug 08 00:40:49.050055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:49.051770 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance 0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:49.051770 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f59b23d5-0501-46b8-a1ca-529cf26b722e tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b" status: 404 len: 111 microversion: 2.1 time: 0.029410 Aug 08 00:40:49.051770 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 493/983] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:49 2022] GET /compute/v2.1/servers/0dcbbc71-d1ca-41a6-ac8e-60d6cf82e51b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:40:50.341653 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:50.342158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:50.344697 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:40:50.349960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:50.350438 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:50.350871 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:50.351612 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:50.352068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:50.352497 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:50.371061 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 HTTP/1.1 Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:40:50.372936 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.374400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '728de657-b1e9-4f61-8dcf-d5cc9553eb16'} Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:50.375184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.388876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.390568 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:50.390568 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-762900f0-ba88-4f17-8eea-b3b0c9b024df tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "DELETE /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 404 len: 111 microversion: 2.1 time: 0.036461 Aug 08 00:40:50.390568 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 491/984] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:40:50 2022] DELETE /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:40:50.390882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:50.390882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] [instance: 728de657-b1e9-4f61-8dcf-d5cc9553eb16] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:40:50.390882 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:50.391701 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:50.391701 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:50.392591 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:40:50.393049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:40:50.393473 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:40:50.407072 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] HTTP exception thrown: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Request method failure captured: Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 HTTP/1.1 Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Fn-lmCIplmAbWz6UDkqPU-5W14DV9hcLhzrOS0PmfnYO0VUSXdbfY7kT7xbj058qnCxyzYa06tFxGrxI5zZxi9Rv6ON745xDZG2lHCg6zR9OPfjs9RnRd76orwCwSAVy5upJE1tFJPBhtJRPlV6fy2U7AQXCVOZlrJ-ainJVT-fuoc Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:40:50.409385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e97eb34021d44eb0a99763034c1e9e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: e97eb34021d44eb0a99763034c1e9e87 Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1002027326 Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 7b317f585f8a4da3abe24ab5cf4ee0c0 Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeNegativeTest-1002027326-project Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.411297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '728de657-b1e9-4f61-8dcf-d5cc9553eb16'} Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:40:50.412300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. Aug 08 00:40:50.413850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:40:50.415446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] Returning 404 to user: Instance 728de657-b1e9-4f61-8dcf-d5cc9553eb16 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:40:50.415446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4a312059-5a26-4035-9042-d314cdfbe550 tempest-AttachVolumeNegativeTest-1002027326 tempest-AttachVolumeNegativeTest-1002027326-project] 10.222.0.15 "GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16" status: 404 len: 111 microversion: 2.1 time: 0.031623 Aug 08 00:40:50.415446 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 494/985] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:40:50 2022] GET /compute/v2.1/servers/728de657-b1e9-4f61-8dcf-d5cc9553eb16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:40:55.963515 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8ffb5fe4-7db7-4759-aa83-9680823ffa78 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Action: 'create', calling method: .version_select at 0x7fd1a1e089d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1485886552"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:56.633720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8ffb5fe4-7db7-4759-aa83-9680823ffa78 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.812953 Aug 08 00:40:56.634336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 492/986] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Aug 8 00:40:55 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 814 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 08 00:40:56.647156 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b379f608-bd36-46dd-b621-8958d5ae195a tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a689a5e0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:56.697267 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b379f608-bd36-46dd-b621-8958d5ae195a tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315" status: 200 len: 345 microversion: 2.1 time: 0.053847 Aug 08 00:40:56.697841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 495/987] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:40:56 2022] GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:57.710990 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d315bf1e-b054-4220-96df-842985a6c92e tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1fa4af0>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:57.757696 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d315bf1e-b054-4220-96df-842985a6c92e tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315" status: 200 len: 346 microversion: 2.1 time: 0.051229 Aug 08 00:40:57.758250 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 493/988] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:40:57 2022] GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:57.770964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ba307009-1adb-4fa3-91c8-5f9da26f8a8a tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Action: 'create', calling method: .version_select at 0x7fd1a1ec5670>, body: {"snapshot": {"volume_id": "df030c21-30ea-4eb9-8e4f-8f561c1bb315", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1159513043"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:40:58.194253 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ba307009-1adb-4fa3-91c8-5f9da26f8a8a tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.427559 Aug 08 00:40:58.194906 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 496/989] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Aug 8 00:40:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:58.207033 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-60118f21-d2db-4f4b-8d29-1ee1c7c01397 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a20eb3a0>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:58.238278 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-60118f21-d2db-4f4b-8d29-1ee1c7c01397 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0" status: 200 len: 287 microversion: 2.1 time: 0.036212 Aug 08 00:40:58.238787 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 494/990] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 00:40:58 2022] GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:58.249328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-131bf394-de7d-4496-af42-2e96a401a32f tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a2b958b0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:58.280530 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-131bf394-de7d-4496-af42-2e96a401a32f tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034281 Aug 08 00:40:58.280712 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 497/991] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Aug 8 00:40:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:58.291883 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-cb89911f-641e-45a0-9910-33638246ff0d tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1fa8af0>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:58.320828 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-cb89911f-641e-45a0-9910-33638246ff0d tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0" status: 200 len: 287 microversion: 2.1 time: 0.032692 Aug 08 00:40:58.321382 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 495/992] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 00:40:58 2022] GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:40:59.334576 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e7a905ca-9456-4cb2-832f-bf868fc03d95 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1e378b0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:40:59.363324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e7a905ca-9456-4cb2-832f-bf868fc03d95 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0" status: 200 len: 287 microversion: 2.1 time: 0.033861 Aug 08 00:40:59.363877 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 498/993] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 00:40:59 2022] GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:00.372764 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:00.376634 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fa5a41bb-bb6b-4852-96a7-df50bec9a0c6 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1e26820>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:00.406581 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fa5a41bb-bb6b-4852-96a7-df50bec9a0c6 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0" status: 200 len: 287 microversion: 2.1 time: 0.034921 Aug 08 00:41:00.407213 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 496/994] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 00:41:00 2022] GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:00.957210 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:00.958012 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:00.962734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:00.968435 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-37197c51-68d9-4bb3-9727-7842bca1e7eb req-c1c1413d-bae4-4efe-ad36-5e70efcf46c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39cb5181-8bc2-4e47-ab31-1f9524d47ef3", "tag": "1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:41:00.972067 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:00.978564 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:00.978730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-37197c51-68d9-4bb3-9727-7842bca1e7eb req-c1c1413d-bae4-4efe-ad36-5e70efcf46c7 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:00.979089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:00.979253 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-37197c51-68d9-4bb3-9727-7842bca1e7eb req-c1c1413d-bae4-4efe-ad36-5e70efcf46c7 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:00.979551 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:00.979668 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-37197c51-68d9-4bb3-9727-7842bca1e7eb req-c1c1413d-bae4-4efe-ad36-5e70efcf46c7 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:00.980322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:00.980886 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:00.981319 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:00.991863 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-37197c51-68d9-4bb3-9727-7842bca1e7eb req-c1c1413d-bae4-4efe-ad36-5e70efcf46c7 service nova] Creating event network-changed:1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0 for instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 on hv-cinder-85164 Aug 08 00:41:00.997212 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-37197c51-68d9-4bb3-9727-7842bca1e7eb req-c1c1413d-bae4-4efe-ad36-5e70efcf46c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032687 Aug 08 00:41:00.998093 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 497/995] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:01.010258 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:41:01.303759 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-dc694d82-0b25-42e6-b3b0-0cce4d451526 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "DELETE /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 204 len: 0 microversion: 2.1 time: 0.348563 Aug 08 00:41:01.304921 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 499/996] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:41:00 2022] DELETE /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:41:01.313763 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:01.315013 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:01.321925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:01.322469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:01.323094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:01.323831 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:01.324280 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:01.324701 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:01.422291 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b3e8d6ec-a84d-4c20-bce2-d007d072dd54 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a689a550>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:01.461707 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b3e8d6ec-a84d-4c20-bce2-d007d072dd54 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0" status: 200 len: 287 microversion: 2.1 time: 0.044683 Aug 08 00:41:01.467396 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 500/997] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 00:41:01 2022] GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:01.481665 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:01.491472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-58cca5f6-e5b3-4b68-97c8-03ab9d1ad654 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.181794 Aug 08 00:41:01.492060 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 498/998] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:01 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:02.474240 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-592d9222-2cfc-4c8e-b43e-7d6c75feddf7 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1fe5af0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:02.504425 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-592d9222-2cfc-4c8e-b43e-7d6c75feddf7 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0" status: 200 len: 288 microversion: 2.1 time: 0.034366 Aug 08 00:41:02.509970 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 501/999] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 00:41:02 2022] GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:02.515794 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c9d41b81-f114-47e7-bf97-5e1f261f3dc5 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1e37550>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:02.518250 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:02.518971 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:02.526566 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:02.527158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:02.527687 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:02.528454 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:02.528912 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:02.529341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:02.661798 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c9d41b81-f114-47e7-bf97-5e1f261f3dc5 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0" status: 202 len: 0 microversion: 2.1 time: 0.149532 Aug 08 00:41:02.662455 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 502/1000] 10.222.0.15 () {58 vars in 1254 bytes} [Mon Aug 8 00:41:02 2022] DELETE /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:41:02.666995 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:02.670812 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-74017ccc-3b6f-4d98-93af-3db7da7c74cf tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1fe5e50>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:02.677769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d1383d29-37bf-42f5-967b-5626bb4ef696 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1566 microversion: 2.1 time: 0.163399 Aug 08 00:41:02.677769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 499/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:02 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:02.702344 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-74017ccc-3b6f-4d98-93af-3db7da7c74cf tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0" status: 200 len: 287 microversion: 2.1 time: 0.035600 Aug 08 00:41:02.702910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 503/1002] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 00:41:02 2022] GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:41:03.576037 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-d9db6fa5-dc74-415b-95a1-6cc6b142dc60 req-d9766021-326d-4a3e-bafc-8acbb06e4ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39cb5181-8bc2-4e47-ab31-1f9524d47ef3", "name": "network-vif-deleted", "tag": "1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:41:03.586572 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-d9db6fa5-dc74-415b-95a1-6cc6b142dc60 req-d9766021-326d-4a3e-bafc-8acbb06e4ad6 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:03.587043 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-d9db6fa5-dc74-415b-95a1-6cc6b142dc60 req-d9766021-326d-4a3e-bafc-8acbb06e4ad6 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:03.589169 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-d9db6fa5-dc74-415b-95a1-6cc6b142dc60 req-d9766021-326d-4a3e-bafc-8acbb06e4ad6 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:03.598880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-d9db6fa5-dc74-415b-95a1-6cc6b142dc60 req-d9766021-326d-4a3e-bafc-8acbb06e4ad6 service nova] Creating event network-vif-deleted:1e516e4f-2b18-41f2-8eaf-d3b6cf4fefb0 for instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 on hv-cinder-85164 Aug 08 00:41:03.603660 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-d9db6fa5-dc74-415b-95a1-6cc6b142dc60 req-d9766021-326d-4a3e-bafc-8acbb06e4ad6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031237 Aug 08 00:41:03.604248 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 500/1003] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:03.697549 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:03.698311 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:03.705311 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:03.705938 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:03.706481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:03.707186 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:03.707665 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:03.708091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:03.715932 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4c2d2cbc-0069-4298-b54a-7ba8ac79225d tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a20e0820>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-4c2d2cbc-0069-4298-b54a-7ba8ac79225d tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] HTTP exception thrown: Snapshot 11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 could not be found. Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4c2d2cbc-0069-4298-b54a-7ba8ac79225d tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Request method failure captured: Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 HTTP/1.1 Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FuXAvcKT__fmC10lz4QGNZjWe_odQUshDFzg47Vpo6prMg2Seww59yyRd6Uduir1Zr_0cyfr4X7HUHFYG-I7BV8vfIgYHjLEylg2NvtgLLTo5SyQ0HOhe-SLH134ppOhVJwIX6cT85AbXMQvRsexdRsEnvXaXoTLZF1oGlt7GySadc Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: c56adfa2f0bf4dd2ba3dbd0db883009f Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:41:03.744530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: c56adfa2f0bf4dd2ba3dbd0db883009f Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesSnapshotsTestJSON-1173301404-project Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: c9f42cb4a8a643c58a9312bbcaef42de Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173301404-project Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Snapshot 11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 could not be found. Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0'} Aug 08 00:41:03.746355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 could not be found. (HTTP 404) (Request-ID: req-8710914f-99b7-4f4f-8c82-4619983af774) Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:03.747740 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:41:03.749142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 could not be found. Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 08 00:41:03.751981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 could not be found. Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 could not be found. Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4c2d2cbc-0069-4298-b54a-7ba8ac79225d tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Returning 404 to user: Snapshot 11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:41:03.759431 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4c2d2cbc-0069-4298-b54a-7ba8ac79225d tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0" status: 404 len: 111 microversion: 2.1 time: 0.034884 Aug 08 00:41:03.760464 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 501/1004] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 00:41:03 2022] GET /compute/v2.1/os-snapshots/11b4c7bf-74d0-4f7b-bf4a-de5c2e3599a0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:41:03.760464 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-fba080cc-5cba-413c-ac48-c40a816afc70 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1e6d430>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:03.786231 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:03.793866 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0bdf6021-f734-4b67-8bf4-36e6a40ea11d tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1218 microversion: 2.1 time: 0.100622 Aug 08 00:41:03.794547 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 504/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:03 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:04.043579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-fba080cc-5cba-413c-ac48-c40a816afc70 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315" status: 202 len: 0 microversion: 2.1 time: 0.291992 Aug 08 00:41:04.044388 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 502/1006] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:41:03 2022] DELETE /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:41:04.053421 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ded3292f-a99f-4ccd-9dac-3d8d5dd7db6c tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a2060c10>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:04.104143 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ded3292f-a99f-4ccd-9dac-3d8d5dd7db6c tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315" status: 200 len: 345 microversion: 2.1 time: 0.051547 Aug 08 00:41:04.104143 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 505/1007] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:41:04 2022] GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:04.815197 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:04.815947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:04.822266 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:04.822775 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:04.823217 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:04.823926 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:04.824378 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:04.824804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:04.855827 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:04.856304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:04.856762 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:04.857200 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.objects.instance [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lazy-loading 'fault' on Instance uuid 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 {{(pid=130172) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:41:04.903586 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0797d03452e9419d93e79ccf1c222391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3101620baddd42c48179a6f411bbd33e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:04.911201 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-975da1ec-3b6a-4c4f-b50e-6e23bdbdc5e0 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 200 len: 1223 microversion: 2.1 time: 0.101127 Aug 08 00:41:04.911788 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 503/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:04 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:05.116130 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d891a349-99b0-4bd7-a337-77241c6a3bcd tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1f15430>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:05.143732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-d891a349-99b0-4bd7-a337-77241c6a3bcd tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] HTTP exception thrown: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d891a349-99b0-4bd7-a337-77241c6a3bcd tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Request method failure captured: Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 HTTP/1.1 Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FuXAvcKT__fmC10lz4QGNZjWe_odQUshDFzg47Vpo6prMg2Seww59yyRd6Uduir1Zr_0cyfr4X7HUHFYG-I7BV8vfIgYHjLEylg2NvtgLLTo5SyQ0HOhe-SLH134ppOhVJwIX6cT85AbXMQvRsexdRsEnvXaXoTLZF1oGlt7GySadc Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: c56adfa2f0bf4dd2ba3dbd0db883009f Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:41:05.146004 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: c56adfa2f0bf4dd2ba3dbd0db883009f Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-VolumesSnapshotsTestJSON-1173301404-project Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: c9f42cb4a8a643c58a9312bbcaef42de Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173301404-project Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': 'df030c21-30ea-4eb9-8e4f-8f561c1bb315'} Aug 08 00:41:05.148433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. (HTTP 404) (Request-ID: req-64c1530a-3451-4e2d-b8b5-795597f56142) Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.149762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:41:05.153178 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 00:41:05.155355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d891a349-99b0-4bd7-a337-77241c6a3bcd tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Returning 404 to user: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d891a349-99b0-4bd7-a337-77241c6a3bcd tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315" status: 404 len: 109 microversion: 2.1 time: 0.035758 Aug 08 00:41:05.157951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 506/1009] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:41:05 2022] GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:41:05.165536 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f60f9eb5-5c82-43c0-a61e-b470ffcee8ff tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a206a550>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:05.199530 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-f60f9eb5-5c82-43c0-a61e-b470ffcee8ff tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] HTTP exception thrown: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f60f9eb5-5c82-43c0-a61e-b470ffcee8ff tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Request method failure captured: Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 HTTP/1.1 Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FuXAvcKT__fmC10lz4QGNZjWe_odQUshDFzg47Vpo6prMg2Seww59yyRd6Uduir1Zr_0cyfr4X7HUHFYG-I7BV8vfIgYHjLEylg2NvtgLLTo5SyQ0HOhe-SLH134ppOhVJwIX6cT85AbXMQvRsexdRsEnvXaXoTLZF1oGlt7GySadc Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: c56adfa2f0bf4dd2ba3dbd0db883009f Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:41:05.201460 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: c56adfa2f0bf4dd2ba3dbd0db883009f Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-VolumesSnapshotsTestJSON-1173301404-project Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: c9f42cb4a8a643c58a9312bbcaef42de Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173301404-project Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'df030c21-30ea-4eb9-8e4f-8f561c1bb315'} Aug 08 00:41:05.203108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. (HTTP 404) (Request-ID: req-1ba06556-a892-45fa-9f50-d15e7bf1fce0) Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.204190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 08 00:41:05.206024 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 08 00:41:05.207570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f60f9eb5-5c82-43c0-a61e-b470ffcee8ff tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Returning 404 to user: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:41:05.209085 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f60f9eb5-5c82-43c0-a61e-b470ffcee8ff tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315" status: 404 len: 109 microversion: 2.1 time: 0.044561 Aug 08 00:41:05.210346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 504/1010] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:41:05 2022] DELETE /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:41:05.212425 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-43539301-dedf-4f85-ac75-cef506c15b90 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Calling method '.version_select at 0x7fd1a1f15a60>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:05.242773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-43539301-dedf-4f85-ac75-cef506c15b90 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] HTTP exception thrown: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-43539301-dedf-4f85-ac75-cef506c15b90 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Request method failure captured: Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 HTTP/1.1 Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FuXAvcKT__fmC10lz4QGNZjWe_odQUshDFzg47Vpo6prMg2Seww59yyRd6Uduir1Zr_0cyfr4X7HUHFYG-I7BV8vfIgYHjLEylg2NvtgLLTo5SyQ0HOhe-SLH134ppOhVJwIX6cT85AbXMQvRsexdRsEnvXaXoTLZF1oGlt7GySadc Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: c56adfa2f0bf4dd2ba3dbd0db883009f Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:41:05.243449 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c56adfa2f0bf4dd2ba3dbd0db883009f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: c56adfa2f0bf4dd2ba3dbd0db883009f Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173301404 Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-VolumesSnapshotsTestJSON-1173301404-project Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: c9f42cb4a8a643c58a9312bbcaef42de Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173301404-project Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': 'df030c21-30ea-4eb9-8e4f-8f561c1bb315'} Aug 08 00:41:05.245066 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. (HTTP 404) (Request-ID: req-e780b8f2-bfaf-4e91-9f8f-6b30691afc87) Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.245933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 08 00:41:05.247158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 08 00:41:05.248512 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-43539301-dedf-4f85-ac75-cef506c15b90 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] Returning 404 to user: Volume df030c21-30ea-4eb9-8e4f-8f561c1bb315 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-43539301-dedf-4f85-ac75-cef506c15b90 tempest-VolumesSnapshotsTestJSON-1173301404 tempest-VolumesSnapshotsTestJSON-1173301404-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315" status: 404 len: 109 microversion: 2.1 time: 0.037404 Aug 08 00:41:05.249797 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 507/1011] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Aug 8 00:41:05 2022] GET /compute/v2.1/os-volumes/df030c21-30ea-4eb9-8e4f-8f561c1bb315 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:41:05.933103 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:05.933886 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] [instance: 39cb5181-8bc2-4e47-ab31-1f9524d47ef3] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:05.940805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:05.941799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:05.942219 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:05.942937 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:05.943405 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:05.943827 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:05.958046 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] HTTP exception thrown: Instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 could not be found. Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Request method failure captured: Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 HTTP/1.1 Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FpA3QVzT0PBQGoX4wjugszRIiDkWDZh5-gNkTeNVRj4GlVKPogkp3gYOv5knT1wjNBUzupPMkMmPFVk7I2_8ze7RzZsR3dS0DIfvaYpIUkgD9-SqHotJtWsH8wNT5GXOR12yFoA88q187Wj8O3SeTUHphweeDhCYgiDIU_s3kDJUEI Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 3101620baddd42c48179a6f411bbd33e Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-TestShelveInstance-1055827311 Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:41:05.960010 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3101620baddd42c48179a6f411bbd33e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3101620baddd42c48179a6f411bbd33e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3101620baddd42c48179a6f411bbd33e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3101620baddd42c48179a6f411bbd33e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-TestShelveInstance-1055827311 Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 3101620baddd42c48179a6f411bbd33e Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-TestShelveInstance-1055827311 Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-TestShelveInstance-1055827311-project Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 0797d03452e9419d93e79ccf1c222391 Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-TestShelveInstance-1055827311-project Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 could not be found. Aug 08 00:41:05.961602 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '39cb5181-8bc2-4e47-ab31-1f9524d47ef3'} Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 could not be found. Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:41:05.962499 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 could not be found. Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 could not be found. Aug 08 00:41:05.963833 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:41:05.965020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Returning 404 to user: Instance 39cb5181-8bc2-4e47-ab31-1f9524d47ef3 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:41:05.965020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-03d900dc-a02f-4a54-976a-fcae9313afa7 tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3" status: 404 len: 111 microversion: 2.1 time: 0.032781 Aug 08 00:41:05.965020 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 505/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:05 2022] GET /compute/v2.1/servers/39cb5181-8bc2-4e47-ab31-1f9524d47ef3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:41:06.192115 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-edd64ee8-080f-4057-af4d-b4744aaabc5f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] Calling method '.version_select at 0x7fd1a1f3da60>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:06.291269 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-edd64ee8-080f-4057-af4d-b4744aaabc5f tempest-TestShelveInstance-1055827311 tempest-TestShelveInstance-1055827311-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-594341581" status: 202 len: 0 microversion: 2.1 time: 0.104624 Aug 08 00:41:06.291862 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 508/1013] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Aug 8 00:41:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-594341581 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:41:21.066773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f68a8e98-c6a9-49ef-95bf-ea3fb0957a00 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:21.067367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f68a8e98-c6a9-49ef-95bf-ea3fb0957a00 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:21.070727 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=15 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:21.071561 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=26 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:21.076507 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a8e98-c6a9-49ef-95bf-ea3fb0957a00 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:21.082420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a8e98-c6a9-49ef-95bf-ea3fb0957a00 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:21.082420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a8e98-c6a9-49ef-95bf-ea3fb0957a00 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:21.082420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a8e98-c6a9-49ef-95bf-ea3fb0957a00 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:21.082420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a8e98-c6a9-49ef-95bf-ea3fb0957a00 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:21.082809 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f68a8e98-c6a9-49ef-95bf-ea3fb0957a00 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:21.106428 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f68a8e98-c6a9-49ef-95bf-ea3fb0957a00 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/ips" status: 200 len: 145 microversion: 2.1 time: 0.043549 Aug 08 00:41:21.107005 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 506/1014] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:41:21 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:23.500461 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:23.501201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:23.505496 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-fdac3635-fd3b-44c2-acaa-24b19de9d017 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e64f20c-0b5f-4b15-9261-eaafb2ac0ea0"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:41:23.507802 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-fdac3635-fd3b-44c2-acaa-24b19de9d017 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:23.513656 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fdac3635-fd3b-44c2-acaa-24b19de9d017 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:23.514132 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fdac3635-fd3b-44c2-acaa-24b19de9d017 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:23.514565 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fdac3635-fd3b-44c2-acaa-24b19de9d017 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:23.515362 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fdac3635-fd3b-44c2-acaa-24b19de9d017 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:23.515813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fdac3635-fd3b-44c2-acaa-24b19de9d017 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:23.516236 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-fdac3635-fd3b-44c2-acaa-24b19de9d017 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:24.225202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-fdac3635-fd3b-44c2-acaa-24b19de9d017 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.725571 Aug 08 00:41:24.226005 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 509/1015] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:41:23 2022] POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/os-volume_attachments => generated 194 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:31.758108 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6a92717e-6623-40b3-9ba6-1be503dfe4bc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:41:31.765318 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a92717e-6623-40b3-9ba6-1be503dfe4bc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:31.765796 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a92717e-6623-40b3-9ba6-1be503dfe4bc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:31.766225 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a92717e-6623-40b3-9ba6-1be503dfe4bc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:31.825836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6a92717e-6623-40b3-9ba6-1be503dfe4bc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Going to try to stop instance {{(pid=130172) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 00:41:31.995270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6a92717e-6623-40b3-9ba6-1be503dfe4bc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/action" status: 202 len: 0 microversion: 2.1 time: 0.241332 Aug 08 00:41:31.995821 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 507/1016] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:41:31 2022] POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:41:32.005816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:32.006537 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:32.012905 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:32.013964 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:32.014447 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:32.015150 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:32.015629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:32.016055 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:32.150537 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:32.157144 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4a7e9aa5-8c27-492e-b8ab-d2a0daef148c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.156979 Aug 08 00:41:32.157713 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 510/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:31 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:32.996084 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1649001106", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-57551070", "security_groups": [{"name": "tempest-secgroup-smoke-259062108"}], "block_device_mapping_v2": [{"uuid": "5e461a01-5ff4-4cf9-b1e8-9af60cfad107", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e16e278d-24ed-46ec-9b21-78207cc53646"}]}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:41:33.107365 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.network.neutron [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] validate_networks() for [('e16e278d-24ed-46ec-9b21-78207cc53646', None, None, None, None, None)] {{(pid=130172) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:41:33.179353 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:33.179353 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:33.186029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:33.186743 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:33.187361 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:33.188234 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:33.188951 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:33.189378 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:33.327656 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:33.336543 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-42769465-8d27-4dbb-92e7-c06f9ab840fe tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.162416 Aug 08 00:41:33.337112 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 511/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:33 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:41:33.492691 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Flavor limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:41:33.493112 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Image limits 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:41:33.493589 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Flavor pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:41:33.494106 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Image pref 0:0:0 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:41:33.494522 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.virt.hardware [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130172) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:41:33.503461 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:33.503940 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:33.504372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:33.505094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:33.505541 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:33.505984 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:33.524101 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Getting quotas for project a22da44baa6b472e91d99fbcb03b583c. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:41:33.528057 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Getting quotas for user 322afd3893ac4c2ba4ab4d449f4d9159 and project a22da44baa6b472e91d99fbcb03b583c. Resources: {'instances', 'cores', 'ram'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:41:33.586466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Going to run 1 instances... {{(pid=130172) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:41:33.588705 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e461a01-5ff4-4cf9-b1e8-9af60cfad107',volume_size=None,volume_type=None)] {{(pid=130172) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:41:34.017624 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6ab2afa2-5631-4f4a-81f7-cca4d13ac6ff tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.026729 Aug 08 00:41:34.018408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 508/1019] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:41:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:41:34.029761 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5d4b9604-42e0-45cd-a244-9191287f537e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:34.030377 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5d4b9604-42e0-45cd-a244-9191287f537e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:34.094048 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5d4b9604-42e0-45cd-a244-9191287f537e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:34.101464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5d4b9604-42e0-45cd-a244-9191287f537e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1093 microversion: 2.1 time: 0.075764 Aug 08 00:41:34.102029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 512/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:34 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:34.358872 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:34.359514 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:34.365954 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:34.366503 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:34.367031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:34.367761 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:34.368219 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:34.368642 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:34.505166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:34.515774 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-388efeb3-a91e-4878-bee4-071e44ddf554 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.158628 Aug 08 00:41:34.515774 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 509/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:34 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:35.122003 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:35.122607 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:35.129541 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:35.130017 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:35.130450 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:35.131130 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:35.131607 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:35.132530 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:35.192940 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:35.205910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2ab146aa-aa25-4693-b77a-0983f727513c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1143 microversion: 2.1 time: 0.087453 Aug 08 00:41:35.207141 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 513/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:35 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:35.533858 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:35.534465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:35.541576 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:35.545579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:35.545579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:35.545579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:35.545579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:35.546178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:35.674903 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:35.683363 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4f38f42c-329f-4cc6-a275-bdd078456885 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.153382 Aug 08 00:41:35.683929 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 510/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:35 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:36.229262 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:36.230013 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:36.236411 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:36.236892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:36.237332 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:36.238023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:36.238477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:36.238902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:36.302108 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:36.310259 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-6c968ee6-e6d4-4452-a2d1-346ee7a1c41a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1199 microversion: 2.1 time: 0.084936 Aug 08 00:41:36.310810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 514/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:36 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:36.704840 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:36.706923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:36.712364 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:36.712852 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:36.713285 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:36.713977 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:36.714426 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:36.714846 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:36.853827 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:36.862031 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a0a594ed-1adb-4ed9-b468-246f011638ba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.161180 Aug 08 00:41:36.862681 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 511/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:36 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:37.332355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:37.333219 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:37.342477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:37.347034 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:37.347034 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:37.347034 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:37.347034 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:37.347433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:37.582204 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:37.589179 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-7f6ce48c-ccc1-4901-9866-f34855d9db6e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1276 microversion: 2.1 time: 0.261625 Aug 08 00:41:37.589856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 515/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:37 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:37.884304 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:37.884908 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:37.891353 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:37.891843 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:37.892282 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:37.892990 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:37.893442 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:37.893898 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:38.033311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:38.042081 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0b0514b4-0f8f-4687-beac-a0397e19fb9c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.161575 Aug 08 00:41:38.048243 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 512/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:37 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:41:38.152734 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-8156706c-3257-4368-90c5-1577186e96ba req-c61bb289-7031-4693-87fc-4ba8ea2d8d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1fb464-5500-49a1-8355-ffa68b6d0e60", "tag": "3077b2e0-65e2-482e-a811-8f38321c9890"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:41:38.162181 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8156706c-3257-4368-90c5-1577186e96ba req-c61bb289-7031-4693-87fc-4ba8ea2d8d2a service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:38.162747 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8156706c-3257-4368-90c5-1577186e96ba req-c61bb289-7031-4693-87fc-4ba8ea2d8d2a service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:38.163703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-8156706c-3257-4368-90c5-1577186e96ba req-c61bb289-7031-4693-87fc-4ba8ea2d8d2a service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:38.174447 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-8156706c-3257-4368-90c5-1577186e96ba req-c61bb289-7031-4693-87fc-4ba8ea2d8d2a service nova] Creating event network-changed:3077b2e0-65e2-482e-a811-8f38321c9890 for instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 on hv-cinder-85164 Aug 08 00:41:38.180534 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-8156706c-3257-4368-90c5-1577186e96ba req-c61bb289-7031-4693-87fc-4ba8ea2d8d2a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031482 Aug 08 00:41:38.181306 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 516/1028] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:38.611103 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:38.611823 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:38.618141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:38.618823 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:38.619623 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:38.620463 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:38.620998 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:38.621492 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:38.752065 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:38.760592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9a54edab-3754-4319-8d36-d8daf27a4c52 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.153329 Aug 08 00:41:38.761174 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 513/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:38 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:39.064696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:39.065494 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:39.072859 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:39.073354 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:39.073794 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:39.074538 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:39.075023 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:39.075504 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:39.214388 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:39.222598 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bf44a0b0-40f2-4e4b-a43b-53a81c1cbf9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.162600 Aug 08 00:41:39.223165 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 517/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:39 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:39.782290 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:39.782847 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:39.789239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:39.789727 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:39.790158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:39.794760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:39.794760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:39.794760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:39.922769 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:39.930779 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-ae819797-2101-46f4-b61f-e4a1e45a579a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.152358 Aug 08 00:41:39.931376 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 514/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:39 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:40.244691 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:40.245299 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:40.251652 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:40.252136 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:40.252568 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:40.253301 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:40.253751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:40.254171 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:40.389298 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:40.397430 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1d5b6c54-e0a3-4b7a-839c-5f152314fac5 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.157300 Aug 08 00:41:40.398910 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 518/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:40 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:40.951141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:40.951773 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:40.958068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:40.958539 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:40.958971 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:40.960438 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:40.961495 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:40.961917 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:41.093367 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:41.101497 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-0ca94dc9-bc86-4114-97f6-33e0827d070f tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.153945 Aug 08 00:41:41.102077 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 515/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:40 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:41.419575 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:41.420183 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:41.426529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:41.427008 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:41.427480 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:41.428166 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:41.428619 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:41.429100 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:41.560089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:41.568034 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b2649810-a200-437a-a01a-045a84748210 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.152420 Aug 08 00:41:41.568600 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 519/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:41 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:42.122803 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:42.123447 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:42.129985 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:42.130465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:42.130947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:42.131669 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:42.132143 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:42.132567 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:42.266082 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:42.273993 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1f9448c9-eac7-42c1-83c1-56c75b301d90 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.154992 Aug 08 00:41:42.274568 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 516/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:42 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:42.590343 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:42.590958 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:42.597359 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:42.597841 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:42.598276 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:42.598967 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:42.599453 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:42.599879 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:42.741067 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:42.749874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b862fccd-86f3-4550-9ecf-37f74de65de9 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.163396 Aug 08 00:41:42.750447 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 520/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:42 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:43.294896 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:43.295550 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:43.302227 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:43.302747 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:43.303215 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:43.303981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:43.304435 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:43.304862 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:43.443072 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:43.451730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-afb02c96-0405-4f4d-a52b-91f50330591e tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.160480 Aug 08 00:41:43.452547 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 517/1037] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:43 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:43.771442 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:43.772008 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:43.778649 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:43.783943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:43.783943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:43.783943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:43.783943 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:43.784349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:43.941085 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:43.950945 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-dcc7e2b7-67ec-4621-9d89-b14794dd59c8 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.183532 Aug 08 00:41:43.951545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 521/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:43 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:44.473394 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:44.473991 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:44.476925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:44.477851 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:44.483250 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:44.483768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:44.484204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:44.484921 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:44.485371 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:44.485794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:44.627416 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:44.635050 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7e7b6fe0-e248-4443-baee-8a90f44cbe22 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.165696 Aug 08 00:41:44.635662 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 518/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:44 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:44.973242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:44.973845 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:44.975885 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:44.981017 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:44.981492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:44.981923 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:44.982604 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:44.983048 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:44.983505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:45.112304 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:45.120488 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f2b902ae-3d14-4507-a818-c85eeee8da53 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.151035 Aug 08 00:41:45.121040 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 522/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:44 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:45.656306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:45.656972 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:45.663911 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:45.664390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:45.664824 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:45.665536 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:45.665992 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:45.666420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:45.798646 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:45.806738 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-95a38935-6d4a-4691-a3c6-b7f5e3225ab0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.154253 Aug 08 00:41:45.807318 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 519/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:45 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:46.144546 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:46.145158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:46.152096 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:46.152580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:46.153013 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:46.153706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:46.154155 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:46.154581 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:46.283899 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:46.291612 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f9e34bc9-5560-4748-a6b3-0db4659e5e45 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.150956 Aug 08 00:41:46.292169 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 523/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:46 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:46.827754 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:46.828382 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:46.835308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:46.835984 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:46.836424 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:46.837113 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:46.837569 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:46.837994 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:46.969661 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:46.977046 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d607548b-15d1-4073-84f1-fb1de06ac4d6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.153235 Aug 08 00:41:46.977608 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 520/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:46 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:47.312580 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:47.313243 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:47.319620 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:47.320104 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:47.320542 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:47.321238 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:47.321691 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:47.322119 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:47.454837 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:47.463408 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-9ba34b57-1571-4a05-8c0d-7dc24d6ec3f7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1723 microversion: 2.1 time: 0.154635 Aug 08 00:41:47.463992 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 524/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:47 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:47.997308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:47.997945 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:48.004416 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:48.004919 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:48.005359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:48.006074 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:48.007017 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:48.007542 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:48.138817 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:48.146188 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-5c9220b9-7fe6-48a9-a497-1b2f2452bd31 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.152795 Aug 08 00:41:48.146755 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 521/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:47 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:41:48.485137 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:48.485751 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:48.492235 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:48.492716 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:48.493154 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:48.493845 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:48.494301 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:48.494724 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:48.619897 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:48.623315 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:48.628100 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-0b2d7a22-6f66-4629-a38d-5ad910aeea5f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1700 microversion: 2.1 time: 0.146826 Aug 08 00:41:48.628664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 525/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:48 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1700 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:48.652317 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-e4827e1d-cc0f-48f2-a06e-ec987f633caf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:41:48.658310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e4827e1d-cc0f-48f2-a06e-ec987f633caf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:48.658817 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e4827e1d-cc0f-48f2-a06e-ec987f633caf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:48.659271 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-e4827e1d-cc0f-48f2-a06e-ec987f633caf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:48.675563 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:41:48.681275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-e4827e1d-cc0f-48f2-a06e-ec987f633caf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Going to try to start instance {{(pid=130172) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 00:41:48.840707 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-e4827e1d-cc0f-48f2-a06e-ec987f633caf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/action" status: 202 len: 0 microversion: 2.1 time: 0.192896 Aug 08 00:41:48.841398 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 522/1047] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:41:48 2022] POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:41:48.849937 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:48.851129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:48.857509 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:48.860481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:48.860481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:48.860481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:48.860481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:48.860866 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:48.997270 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:49.005412 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5faae4a2-cce7-4a78-ab74-a8969ffa76b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1709 microversion: 2.1 time: 0.159709 Aug 08 00:41:49.006068 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 526/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:48 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:49.169086 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:49.169805 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:49.176588 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:49.177067 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:49.177529 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:49.178240 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:49.178859 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:49.179311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:49.310592 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:49.318384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-31675d4d-b674-4890-a32d-bd9a1100e329 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.153897 Aug 08 00:41:49.319070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 523/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:49 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:49.540067 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-83663e6c-07f4-487b-b589-1bafceadc254 req-d8bd2cd9-7ab7-439f-828a-a8bf4959df0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1fb464-5500-49a1-8355-ffa68b6d0e60", "name": "network-vif-plugged", "status": "completed", "tag": "3077b2e0-65e2-482e-a811-8f38321c9890"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:41:49.551296 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-83663e6c-07f4-487b-b589-1bafceadc254 req-d8bd2cd9-7ab7-439f-828a-a8bf4959df0d service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:49.551781 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-83663e6c-07f4-487b-b589-1bafceadc254 req-d8bd2cd9-7ab7-439f-828a-a8bf4959df0d service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:49.552218 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-83663e6c-07f4-487b-b589-1bafceadc254 req-d8bd2cd9-7ab7-439f-828a-a8bf4959df0d service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:49.564545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-83663e6c-07f4-487b-b589-1bafceadc254 req-d8bd2cd9-7ab7-439f-828a-a8bf4959df0d service nova] Creating event network-vif-plugged:3077b2e0-65e2-482e-a811-8f38321c9890 for instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 on hv-cinder-85164 Aug 08 00:41:49.568355 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-83663e6c-07f4-487b-b589-1bafceadc254 req-d8bd2cd9-7ab7-439f-828a-a8bf4959df0d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032376 Aug 08 00:41:49.569460 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 527/1050] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:41:50.026966 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:50.027607 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:50.033532 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:50.034012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:50.034452 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:50.035135 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:50.035648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:50.036073 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:50.172521 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:50.181516 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1b952347-d784-4bc2-931e-259b1e57b8cf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1709 microversion: 2.1 time: 0.158356 Aug 08 00:41:50.182090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 524/1051] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:50 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:50.339438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:50.340175 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:50.346238 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:50.346852 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:50.347325 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:50.348047 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:50.348500 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:50.348925 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:50.483456 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:50.491553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-791d977a-5e72-4512-ad60-7afec041554c tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.156154 Aug 08 00:41:50.492162 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 528/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:50 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:51.202179 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:51.202820 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:51.209247 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:51.210400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:51.210839 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:51.211560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:51.212015 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:51.212441 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:51.341104 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:51.348973 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1c715793-49af-42e9-b930-b8702cc323e1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1713 microversion: 2.1 time: 0.150600 Aug 08 00:41:51.349532 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 525/1053] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:51 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:51.512867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:51.513415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:51.520035 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:51.520521 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:51.520963 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:51.521664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:51.522153 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:51.522579 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:51.680577 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:51.688116 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2e858645-b45e-44e2-88f2-18d8490802c2 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1264 microversion: 2.1 time: 0.179185 Aug 08 00:41:51.688681 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 529/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:51 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:52.709384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:52.710700 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:52.717184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:52.717656 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:52.718088 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:52.718770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:52.719216 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:52.719656 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:52.849979 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:52.858219 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-a29b64e6-da3c-4f3d-abf8-63454bcd6a27 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1451 microversion: 2.1 time: 0.152799 Aug 08 00:41:52.858785 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 526/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:52 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:52.877771 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:41:52.878381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:41:52.885163 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:52.885654 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:52.886098 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:52.886799 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:52.887326 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:52.887755 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:53.017338 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:41:53.025382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a58fbd86-db04-4296-9311-ef3aa0f0cfd5 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1451 microversion: 2.1 time: 0.151368 Aug 08 00:41:53.025941 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 530/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:41:52 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:41:54.891882 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-cdd8e06d-a66f-49c0-adff-031fa252919b req-a28980e9-04db-4c40-8a4f-7de3d03c98ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1fb464-5500-49a1-8355-ffa68b6d0e60", "tag": "3077b2e0-65e2-482e-a811-8f38321c9890"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:41:54.902423 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-cdd8e06d-a66f-49c0-adff-031fa252919b req-a28980e9-04db-4c40-8a4f-7de3d03c98ab service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:41:54.902981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-cdd8e06d-a66f-49c0-adff-031fa252919b req-a28980e9-04db-4c40-8a4f-7de3d03c98ab service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:41:54.903518 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-cdd8e06d-a66f-49c0-adff-031fa252919b req-a28980e9-04db-4c40-8a4f-7de3d03c98ab service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:41:54.915130 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-cdd8e06d-a66f-49c0-adff-031fa252919b req-a28980e9-04db-4c40-8a4f-7de3d03c98ab service nova] Creating event network-changed:3077b2e0-65e2-482e-a811-8f38321c9890 for instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 on hv-cinder-85164 Aug 08 00:41:54.920336 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-cdd8e06d-a66f-49c0-adff-031fa252919b req-a28980e9-04db-4c40-8a4f-7de3d03c98ab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032420 Aug 08 00:41:54.920999 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 527/1057] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:42:25.082675 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:25.083249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:25.085514 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=46 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:42:25.086976 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=26 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:42:25.091575 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:25.092050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:25.092504 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:25.093187 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:25.093640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:25.094056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:25.370741 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lazy-loading 'services' on Instance uuid 62011870-5958-4d03-9ab1-9edb56112d1c {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:42:25.585398 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c3241be7-be0a-4ee0-8b57-b84e003ef08d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "DELETE /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/os-volume_attachments/8e64f20c-0b5f-4b15-9261-eaafb2ac0ea0" status: 202 len: 0 microversion: 2.1 time: 0.506485 Aug 08 00:42:25.585976 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 531/1058] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:42:25 2022] DELETE /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/os-volume_attachments/8e64f20c-0b5f-4b15-9261-eaafb2ac0ea0 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:42:26.702254 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:42:26.703104 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:42:26.707125 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-27ddb447-15fa-4279-93cb-b994c2fbf7d1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:42:26.714222 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27ddb447-15fa-4279-93cb-b994c2fbf7d1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:26.714699 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27ddb447-15fa-4279-93cb-b994c2fbf7d1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:26.715131 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-27ddb447-15fa-4279-93cb-b994c2fbf7d1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:26.736510 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-27ddb447-15fa-4279-93cb-b994c2fbf7d1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Going to try to stop instance {{(pid=130172) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 08 00:42:26.953927 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-27ddb447-15fa-4279-93cb-b994c2fbf7d1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/action" status: 202 len: 0 microversion: 2.1 time: 0.253161 Aug 08 00:42:26.954475 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 528/1059] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:42:26 2022] POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:42:26.964091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:26.964874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:26.970892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:26.976088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:26.976088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:26.976088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:26.976088 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:26.976745 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:27.101881 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:27.109297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8d88f119-3830-4b37-9b99-df7b285ec0f3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1677 microversion: 2.1 time: 0.150433 Aug 08 00:42:27.109851 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 532/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:26 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:28.132837 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:28.133654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:28.140111 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:28.140594 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:28.141029 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:28.141723 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:28.142176 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:28.142601 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:28.631745 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:28.639359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4404df76-7980-4fd7-936f-6002a8b910b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1677 microversion: 2.1 time: 0.512025 Aug 08 00:42:28.639928 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 529/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:28 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1677 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:29.664874 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:29.665506 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:29.673329 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:29.673808 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:29.674238 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:29.674934 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:29.675420 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:29.675838 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:29.808586 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:29.816038 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-1931e72b-c0e5-4e2a-ba5f-5ea21c3f8768 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1677 microversion: 2.1 time: 0.159221 Aug 08 00:42:29.816589 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 533/1062] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:29 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:30.837570 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:30.838124 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:30.844600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:30.845079 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:30.845518 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:30.846213 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:30.846669 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:30.847098 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:30.972636 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:30.980683 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-41c5faa6-1199-498a-baaa-71b620b92179 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1677 microversion: 2.1 time: 0.147457 Aug 08 00:42:30.981241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 530/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:30 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:32.004266 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:32.004788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:32.011674 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:32.012158 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:32.012585 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:32.013268 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:32.013716 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:32.014135 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:32.038004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:42:32.038698 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Mon Aug 8 00:42:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:42:32.142777 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:32.150473 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-10756337-28b7-4c24-bedc-de49cba5bf6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1677 microversion: 2.1 time: 0.150198 Aug 08 00:42:32.151049 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 534/1064] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:31 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:33.170915 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:33.171548 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:33.178509 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:33.178989 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:33.179468 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:33.180160 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:33.180611 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:33.181034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:33.317275 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:33.326264 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-75884930-e757-4bf2-852b-876becba8794 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1677 microversion: 2.1 time: 0.159176 Aug 08 00:42:33.326820 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 531/1065] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:33 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:34.348032 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:34.348658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:34.355915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:34.356386 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:34.356816 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:34.357495 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:34.357944 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:34.358365 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:34.490133 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:34.497787 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-743781dc-6f8d-4927-bf4f-0a198dc79367 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1677 microversion: 2.1 time: 0.153572 Aug 08 00:42:34.498390 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 535/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:34 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:35.519290 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:35.519932 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:35.526309 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:35.526789 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:35.527240 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:35.528014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:35.528467 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:35.528897 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:35.654461 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:35.661974 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c4407618-d36d-451c-87e8-d30b6956f772 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1677 microversion: 2.1 time: 0.146576 Aug 08 00:42:35.662533 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 532/1067] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:35 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:36.684027 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:36.687191 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:36.691545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:36.692034 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:36.692469 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:36.693168 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:36.693620 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:36.694043 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:36.905375 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:36.912985 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ffc2ddc2-d636-44f7-969a-156eae725071 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1677 microversion: 2.1 time: 0.233468 Aug 08 00:42:36.913544 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 536/1068] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:36 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:37.935055 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:37.935634 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:37.942167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:37.942640 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:37.943070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:37.943792 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:37.944238 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:37.944655 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:38.074902 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:38.082366 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6a3e2be4-cb6f-40d7-a68d-8ab6598ca191 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1654 microversion: 2.1 time: 0.151292 Aug 08 00:42:38.082923 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 533/1069] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:37 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:38.103690 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2fb8ff7e-2d98-4b29-954f-e5fd0ca60a4b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:42:38.109998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2fb8ff7e-2d98-4b29-954f-e5fd0ca60a4b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:38.110475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2fb8ff7e-2d98-4b29-954f-e5fd0ca60a4b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:38.110936 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2fb8ff7e-2d98-4b29-954f-e5fd0ca60a4b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:38.169699 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2fb8ff7e-2d98-4b29-954f-e5fd0ca60a4b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Going to try to start instance {{(pid=130173) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 08 00:42:38.354545 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2fb8ff7e-2d98-4b29-954f-e5fd0ca60a4b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/action" status: 202 len: 0 microversion: 2.1 time: 0.255080 Aug 08 00:42:38.355250 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 537/1070] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Aug 8 00:42:38 2022] POST /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:42:38.363281 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:38.373320 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:38.373320 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:38.373320 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:38.373320 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:38.373746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:38.373746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:38.373746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:38.502054 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:38.511401 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1267064e-3c6e-4c26-84bf-bcb7a2190d9f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1663 microversion: 2.1 time: 0.151980 Aug 08 00:42:38.511986 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 534/1071] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:38 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:39.534637 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:39.535366 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:39.542309 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:39.542824 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:39.543286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:39.543979 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:39.544436 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:39.544857 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:39.673731 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:39.681385 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-cc0ad631-daaa-44d0-bbf9-e4da773cf0e4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1663 microversion: 2.1 time: 0.151376 Aug 08 00:42:39.681941 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 538/1072] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:39 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:42:39.949217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:42:39.949430 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Mon Aug 8 00:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:42:40.701934 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:42:40.702543 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:42:40.709014 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:40.709488 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:40.709947 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:40.710894 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:42:40.711379 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:42:40.711806 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:42:40.840659 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:42:40.848204 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-c8bab2b0-3740-4a4d-b0a8-4fbf152f4dbf tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1667 microversion: 2.1 time: 0.150221 Aug 08 00:42:40.848758 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 535/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:42:40 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:13.308429 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-349b4770-045c-4a8c-bf0a-2d7ac20a8181 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:13.310711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-349b4770-045c-4a8c-bf0a-2d7ac20a8181 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:13.312972 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=16 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:13.313628 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:13.318917 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-349b4770-045c-4a8c-bf0a-2d7ac20a8181 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:13.326433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-349b4770-045c-4a8c-bf0a-2d7ac20a8181 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:13.326433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-349b4770-045c-4a8c-bf0a-2d7ac20a8181 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:13.326433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-349b4770-045c-4a8c-bf0a-2d7ac20a8181 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:13.326433 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-349b4770-045c-4a8c-bf0a-2d7ac20a8181 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:13.326915 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-349b4770-045c-4a8c-bf0a-2d7ac20a8181 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:13.350387 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-349b4770-045c-4a8c-bf0a-2d7ac20a8181 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045812 Aug 08 00:43:13.350933 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 539/1074] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:43:13 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 00:43:13.413552 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:13.414066 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:13.416843 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=16 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:13.417504 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:13.422131 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:13.422608 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:13.423043 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:13.423795 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:13.424249 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:13.424670 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:13.449793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Going to try to terminate instance {{(pid=130172) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:43:13.772799 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-960ddbcd-39ff-4995-bd66-732765fc0b13 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "DELETE /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 204 len: 0 microversion: 2.1 time: 0.362988 Aug 08 00:43:13.773395 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 536/1075] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:43:13 2022] DELETE /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 08 00:43:13.782326 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:13.786109 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:13.789404 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:13.789846 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:13.790300 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:13.790987 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:13.791472 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:13.791892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:13.927590 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:13.935078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-b117a821-1552-415e-841f-c62d03617d48 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1673 microversion: 2.1 time: 0.156918 Aug 08 00:43:13.935661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 540/1076] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:13 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:14.957420 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:14.958055 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:14.965263 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:14.965747 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:14.966183 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:14.966906 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:14.967396 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:14.967830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:15.099457 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:15.106959 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-93aa67f2-8d6f-4c87-850c-e45b6337d981 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1673 microversion: 2.1 time: 0.153803 Aug 08 00:43:15.107768 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 537/1077] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:14 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:16.128052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:16.128669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:16.135828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:16.136839 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:16.137387 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:16.137773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:16.138227 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:16.138653 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:16.584201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:16.592511 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f56a17ed-5145-4b51-9cca-711fb8889cc3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1673 microversion: 2.1 time: 0.468283 Aug 08 00:43:16.593285 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 541/1078] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:16 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1673 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:17.284562 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-cac7fce1-2ea6-45b3-89f7-80b84a77f4fb req-0365ca55-a758-44d1-8f13-8da22cd0e450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62011870-5958-4d03-9ab1-9edb56112d1c", "name": "network-vif-deleted", "tag": "4bbb3fd2-65fd-4af3-a645-58300f7aae93"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:17.295028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-cac7fce1-2ea6-45b3-89f7-80b84a77f4fb req-0365ca55-a758-44d1-8f13-8da22cd0e450 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:17.295539 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-cac7fce1-2ea6-45b3-89f7-80b84a77f4fb req-0365ca55-a758-44d1-8f13-8da22cd0e450 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:17.295981 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-cac7fce1-2ea6-45b3-89f7-80b84a77f4fb req-0365ca55-a758-44d1-8f13-8da22cd0e450 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:17.310778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-cac7fce1-2ea6-45b3-89f7-80b84a77f4fb req-0365ca55-a758-44d1-8f13-8da22cd0e450 service nova] Creating event network-vif-deleted:4bbb3fd2-65fd-4af3-a645-58300f7aae93 for instance 62011870-5958-4d03-9ab1-9edb56112d1c on hv-cinder-85164 Aug 08 00:43:17.316232 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-cac7fce1-2ea6-45b3-89f7-80b84a77f4fb req-0365ca55-a758-44d1-8f13-8da22cd0e450 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098155 Aug 08 00:43:17.317262 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 538/1079] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:17.614086 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:17.615381 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:17.622732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:17.623217 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:17.623678 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:17.624376 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:17.624825 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:17.625246 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:17.659828 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:17.660220 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:17.660654 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:17.661091 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lazy-loading 'fault' on Instance uuid 62011870-5958-4d03-9ab1-9edb56112d1c {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:43:17.709296 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:17.711668 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a57fea03-027c-462b-8f25-4359b9be1adb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 200 len: 1327 microversion: 2.1 time: 0.101357 Aug 08 00:43:17.712249 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 542/1080] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:17 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:18.734918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:18.735632 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:18.741849 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:18.742908 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:18.743372 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:18.744059 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:18.744505 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:18.744925 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:18.758750 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] HTTP exception thrown: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Request method failure captured: Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c HTTP/1.1 Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Ftzna2_8x5nrcKUtrH5FhUTIg-8ZHL7q6qUuijFoK6VYwHLpVba8t1u8RCPPyChTXN33nL5JiJTZG83WHHuueMwMDAeIm1MBV7ZMlYdhfI8QuZrRMEFQ4DF5-SkdKeD_G5gMA5lGj5DNyo7NCH7zenvvcxjYjxtHzgujvb7P_bSJCM Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:43:18.760408 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 1f22b554ae524ccf9a8777ac24cdd688 Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:43:18.762120 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '62011870-5958-4d03-9ab1-9edb56112d1c'} Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:43:18.763341 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:43:18.764939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:18.766553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Returning 404 to user: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:43:18.766553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-3a4ede7e-d232-4165-b8d7-97db5a11e630 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 404 len: 111 microversion: 2.1 time: 0.031569 Aug 08 00:43:18.766553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 539/1081] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:18 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:43:18.770656 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f9619ff4-cd00-417b-b4db-a4bbb9920991 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '.version_select at 0x7fd1a2044ee0>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:18.775202 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9619ff4-cd00-417b-b4db-a4bbb9920991 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [7995486c-98f1-4411-8090-bcb3653dec0f] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 08 00:43:19.784477 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9619ff4-cd00-417b-b4db-a4bbb9920991 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [7995486c-98f1-4411-8090-bcb3653dec0f] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 56982. Aug 08 00:43:19.906489 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f9619ff4-cd00-417b-b4db-a4bbb9920991 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-191832724" status: 202 len: 0 microversion: 2.1 time: 1.139531 Aug 08 00:43:19.907094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 543/1082] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 8 00:43:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-191832724 => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:43:20.590648 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-45e41f48-4954-415e-807c-7e996874d915 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'create', calling method: .version_select at 0x7fd1a21f09d0>, body: {"keypair": {"name": "tempest-keypair-197173968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzc5ixd9A3REc8m8KB8VUxenmP7mKjprkmIbsvciCrcVcU+68/z5zer+JQ00r6MczCAYjTWZQ7+PnuiKvceoPYkON+eypdLHufQZbIiuyyTmZA+FGd7MmtoH1cvWDpCTQ=="}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:20.607015 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-45e41f48-4954-415e-807c-7e996874d915 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Getting quotas for project 2c27d244bd514766b955d1a4aba239eb. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:43:20.610771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.quota [None req-45e41f48-4954-415e-807c-7e996874d915 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Getting quotas for user 1f22b554ae524ccf9a8777ac24cdd688 and project 2c27d244bd514766b955d1a4aba239eb. Resources: {'key_pairs'} {{(pid=130172) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:43:20.684330 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-45e41f48-4954-415e-807c-7e996874d915 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097525 Aug 08 00:43:20.684940 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 540/1083] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Aug 8 00:43:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:22.914912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-980157191", "imageRef": "153ac14c-73b5-4e14-a63b-5350aac5fc90", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1ea4937-9f88-413c-acfe-262c6911cb43"}], "security_groups": [{"name": "tempest-securitygroup--701434204"}], "key_name": "tempest-keypair-197173968", "user_data": "}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:23.018507 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.network.neutron [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] validate_networks() for [('a1ea4937-9f88-413c-acfe-262c6911cb43', None, None, None, None, None)] {{(pid=130173) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 08 00:43:23.433294 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Flavor limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 08 00:43:23.433720 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Image limits 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 08 00:43:23.434194 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Flavor pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 08 00:43:23.434652 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Image pref 0:0:0 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 08 00:43:23.435045 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.virt.hardware [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130173) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 08 00:43:23.443773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:23.444252 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:23.444686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:23.445464 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:23.445912 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:23.446335 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:23.463411 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Getting quotas for project 2c27d244bd514766b955d1a4aba239eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 08 00:43:23.467294 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.quota [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Getting quotas for user 1f22b554ae524ccf9a8777ac24cdd688 and project 2c27d244bd514766b955d1a4aba239eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130173) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 08 00:43:23.478622 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Going to run 1 instances... {{(pid=130173) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 08 00:43:23.480873 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='153ac14c-73b5-4e14-a63b-5350aac5fc90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130173) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 08 00:43:23.586829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-2545a8b1-7013-4bab-9934-ad7ea7e8cc03 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676624 Aug 08 00:43:23.587505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 544/1084] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Aug 8 00:43:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 08 00:43:23.598387 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-982cff9a-fd55-4024-93c8-14708b98a9dc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:23.599000 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-982cff9a-fd55-4024-93c8-14708b98a9dc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:23.658318 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-982cff9a-fd55-4024-93c8-14708b98a9dc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:23.666015 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-982cff9a-fd55-4024-93c8-14708b98a9dc tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1236 microversion: 2.1 time: 0.071426 Aug 08 00:43:23.666770 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 541/1085] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:23 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:24.687370 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:24.687983 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:24.694161 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:24.694663 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:24.695737 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:24.696440 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:24.696987 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:24.697418 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:24.758838 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:24.766570 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3c0f7948-c7ff-4dd5-9ad9-a0acc7af5746 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1240 microversion: 2.1 time: 0.083489 Aug 08 00:43:24.767176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 545/1086] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:24 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:25.786937 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:25.787578 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:25.794674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:25.795190 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:25.795878 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:25.796579 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:25.797039 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:25.797466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:25.862843 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:25.870948 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4038fe1a-e84d-453e-bfc8-f55710f35ebd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1306 microversion: 2.1 time: 0.087844 Aug 08 00:43:25.871560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 542/1087] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:25 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1306 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:26.895884 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:26.896521 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:26.903614 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:26.904099 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:26.904538 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:26.905231 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:26.905685 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:26.906115 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:27.144777 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:27.153071 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-f09c95bb-ca13-47ea-8b26-f821b54b0ff4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1361 microversion: 2.1 time: 0.261102 Aug 08 00:43:27.153645 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 546/1088] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:26 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:27.264466 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-2bb7d7c7-95f6-4c20-b502-564d0217150f req-47374c3c-106c-441e-9ba9-72a379f9f26f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a72cc2-9190-43cd-9a38-5c40247f06fe", "tag": "886303e5-14f6-4125-ae5f-830989d01818"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:27.274066 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2bb7d7c7-95f6-4c20-b502-564d0217150f req-47374c3c-106c-441e-9ba9-72a379f9f26f service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:27.275087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2bb7d7c7-95f6-4c20-b502-564d0217150f req-47374c3c-106c-441e-9ba9-72a379f9f26f service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:27.275544 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-2bb7d7c7-95f6-4c20-b502-564d0217150f req-47374c3c-106c-441e-9ba9-72a379f9f26f service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:27.286141 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-2bb7d7c7-95f6-4c20-b502-564d0217150f req-47374c3c-106c-441e-9ba9-72a379f9f26f service nova] Creating event network-changed:886303e5-14f6-4125-ae5f-830989d01818 for instance b6a72cc2-9190-43cd-9a38-5c40247f06fe on hv-cinder-85164 Aug 08 00:43:27.291094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-2bb7d7c7-95f6-4c20-b502-564d0217150f req-47374c3c-106c-441e-9ba9-72a379f9f26f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030373 Aug 08 00:43:27.291780 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 543/1089] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:28.173926 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:28.174467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:28.181461 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:28.181934 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:28.182364 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:28.183050 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:28.183535 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:28.183957 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:28.315613 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:28.323275 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e2845d1f-0979-41f3-a2f0-675a685902b0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1361 microversion: 2.1 time: 0.153188 Aug 08 00:43:28.323845 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 547/1090] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:28 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:43:29.344791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:29.345484 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:29.351707 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:29.352693 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:29.353253 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:29.354041 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:29.354500 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:29.354930 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:29.482406 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:29.489742 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-564742d9-b80b-4784-88c1-cdca9734098a tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1361 microversion: 2.1 time: 0.149709 Aug 08 00:43:29.490308 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 544/1091] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:29 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:30.510998 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:30.511646 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:30.517696 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:30.518176 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:30.518610 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:30.519318 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:30.519772 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:30.520196 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:30.647205 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:30.658629 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-e8148753-c90f-4941-aed1-f50d0d2016fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1361 microversion: 2.1 time: 0.151390 Aug 08 00:43:30.659242 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 548/1092] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:30 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:43:31.498273 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:31.498816 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:31.506359 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:31.506841 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:31.507299 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:31.508319 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:31.509355 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:31.509772 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:31.536522 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Going to try to terminate instance {{(pid=130172) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:43:31.563110 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-54deb95a-af55-4447-92b3-34888625af80 req-8d50c9f1-bdd6-4ca8-af73-95110bbbd499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d1fb464-5500-49a1-8355-ffa68b6d0e60", "tag": "3077b2e0-65e2-482e-a811-8f38321c9890"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:31.573316 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-54deb95a-af55-4447-92b3-34888625af80 req-8d50c9f1-bdd6-4ca8-af73-95110bbbd499 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:31.574063 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-54deb95a-af55-4447-92b3-34888625af80 req-8d50c9f1-bdd6-4ca8-af73-95110bbbd499 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:31.574492 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-54deb95a-af55-4447-92b3-34888625af80 req-8d50c9f1-bdd6-4ca8-af73-95110bbbd499 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:31.590201 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-54deb95a-af55-4447-92b3-34888625af80 req-8d50c9f1-bdd6-4ca8-af73-95110bbbd499 service nova] Creating event network-changed:3077b2e0-65e2-482e-a811-8f38321c9890 for instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 on hv-cinder-85164 Aug 08 00:43:31.591337 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-54deb95a-af55-4447-92b3-34888625af80 req-8d50c9f1-bdd6-4ca8-af73-95110bbbd499 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093723 Aug 08 00:43:31.591934 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 549/1093] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:31.681987 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:31.682683 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:31.689168 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:31.689647 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:31.690110 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:31.690817 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:31.691423 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:31.691786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:31.819034 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-35909db0-951f-4bb9-906c-a74ec809e51d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 204 len: 0 microversion: 2.1 time: 0.324585 Aug 08 00:43:31.819826 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 545/1094] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:43:31 2022] DELETE /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:43:31.829402 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:31.830454 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:31.839166 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:31.839786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:31.840412 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:31.841280 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:31.842027 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:31.842465 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:31.880939 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:31.888892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-8afbc104-5586-4447-9a71-9805e34fce3e tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1361 microversion: 2.1 time: 0.211715 Aug 08 00:43:31.902334 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 550/1095] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:31 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:32.008021 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:32.019178 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-4679827a-3244-4d45-b7d8-9b4d9f2bffe0 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1576 microversion: 2.1 time: 0.193442 Aug 08 00:43:32.020328 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 546/1096] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:31 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:32.909365 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:32.909886 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:32.917081 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:32.917555 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:32.917990 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:32.918673 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:32.919123 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:32.919578 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:33.042315 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:33.043084 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:33.045366 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:33.049520 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:33.050004 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:33.050441 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:33.051144 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:33.051628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:33.052058 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:33.052729 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-bd214e05-3d35-428f-a821-5a14ec602faa tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1361 microversion: 2.1 time: 0.147378 Aug 08 00:43:33.053295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 551/1097] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:32 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:33.185143 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:33.192644 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-1a866f00-8709-4830-a630-ff33d1507bb4 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1576 microversion: 2.1 time: 0.155222 Aug 08 00:43:33.193311 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 547/1098] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:33 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:43:34.048062 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-fe9a6a01-e84e-4355-9fce-f1202f853a21 req-23c4ed42-157a-4d6e-981a-9f0b39282cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a72cc2-9190-43cd-9a38-5c40247f06fe", "name": "network-vif-plugged", "status": "completed", "tag": "886303e5-14f6-4125-ae5f-830989d01818"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:34.053113 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:34.053732 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell0:SELECT=6 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:34.060761 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-fe9a6a01-e84e-4355-9fce-f1202f853a21 req-23c4ed42-157a-4d6e-981a-9f0b39282cbf service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:34.061256 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-fe9a6a01-e84e-4355-9fce-f1202f853a21 req-23c4ed42-157a-4d6e-981a-9f0b39282cbf service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:34.061679 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-fe9a6a01-e84e-4355-9fce-f1202f853a21 req-23c4ed42-157a-4d6e-981a-9f0b39282cbf service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:34.072973 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-fe9a6a01-e84e-4355-9fce-f1202f853a21 req-23c4ed42-157a-4d6e-981a-9f0b39282cbf service nova] Creating event network-vif-plugged:886303e5-14f6-4125-ae5f-830989d01818 for instance b6a72cc2-9190-43cd-9a38-5c40247f06fe on hv-cinder-85164 Aug 08 00:43:34.076310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:34.076310 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:34.078003 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell0:SELECT=6 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:34.078165 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-fe9a6a01-e84e-4355-9fce-f1202f853a21 req-23c4ed42-157a-4d6e-981a-9f0b39282cbf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033991 Aug 08 00:43:34.078895 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 552/1099] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:34.086261 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:34.086860 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:34.087949 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:34.089012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:34.089846 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:34.095444 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:34.154855 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [req-e042fd02-cfd4-40c9-818f-d67c33d49b6a req-cd410ecd-9c73-4f05-8c73-8a121147aaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d1fb464-5500-49a1-8355-ffa68b6d0e60", "name": "network-vif-deleted", "tag": "3077b2e0-65e2-482e-a811-8f38321c9890"}]} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:34.167657 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-e042fd02-cfd4-40c9-818f-d67c33d49b6a req-cd410ecd-9c73-4f05-8c73-8a121147aaba service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:34.168144 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-e042fd02-cfd4-40c9-818f-d67c33d49b6a req-cd410ecd-9c73-4f05-8c73-8a121147aaba service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:34.168798 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [req-e042fd02-cfd4-40c9-818f-d67c33d49b6a req-cd410ecd-9c73-4f05-8c73-8a121147aaba service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:34.180078 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.compute.server_external_events [req-e042fd02-cfd4-40c9-818f-d67c33d49b6a req-cd410ecd-9c73-4f05-8c73-8a121147aaba service nova] Creating event network-vif-deleted:3077b2e0-65e2-482e-a811-8f38321c9890 for instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 on hv-cinder-85164 Aug 08 00:43:34.185583 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [req-e042fd02-cfd4-40c9-818f-d67c33d49b6a req-cd410ecd-9c73-4f05-8c73-8a121147aaba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035183 Aug 08 00:43:34.186193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 553/1100] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:34.214191 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:34.214902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:34.221803 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:34.222345 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:34.222791 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:34.223527 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:34.223988 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:34.224419 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:34.260151 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:34.269150 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-9d59a931-dfb5-4519-b57d-1b05a3b2bf67 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1361 microversion: 2.1 time: 0.199109 Aug 08 00:43:34.269744 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 548/1101] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:34 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:43:34.293089 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:34.301061 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-74e34930-b615-40c0-9f03-936f9b95c9c6 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1390 microversion: 2.1 time: 0.091602 Aug 08 00:43:34.301642 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 554/1102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:34 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:43:35.292455 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:35.293065 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:35.299996 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:35.300477 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:35.300915 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:35.301639 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:35.302094 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:35.302667 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:35.321830 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:35.322415 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:35.328778 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:35.329259 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:35.329693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:35.330390 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:35.330843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:35.331295 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:35.365294 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:35.365770 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:35.366200 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:35.366639 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lazy-loading 'fault' on Instance uuid 8d1fb464-5500-49a1-8355-ffa68b6d0e60 {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:43:35.407691 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:35.415382 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-758589e9-9206-419b-bea1-e4d61fb22a17 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 200 len: 1229 microversion: 2.1 time: 0.097375 Aug 08 00:43:35.416148 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 555/1103] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:35 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 08 00:43:35.435603 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:35.442995 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-d87b7b86-9639-4414-8610-e9bab7a76086 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1361 microversion: 2.1 time: 0.155127 Aug 08 00:43:35.443635 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 549/1104] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:35 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:36.437859 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:36.438577 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: 8d1fb464-5500-49a1-8355-ffa68b6d0e60] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:36.445451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:36.446045 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:36.446556 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:36.447478 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:36.448003 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:36.448500 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:36.462867 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] HTTP exception thrown: Instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 could not be found. Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Request method failure captured: Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 HTTP/1.1 Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FpjFCxWg70FWQQl9rIKacZPbN4w7caocEk9_WTRmaUCRXlCvoib93fpml7Uz8ekZmx9G7YVI2yqQsUJ_eoc8qDz5SRP1OcUViRY6ryHH9_oL1fdgxgJljw5PvLIQYX4XaEZBe5xECurylkdI6SVPRj4HRZ9ACEEhoU2HWayHsQUIak Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:43:36.464870 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 322afd3893ac4c2ba4ab4d449f4d9159 Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 could not be found. Aug 08 00:43:36.466357 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '8d1fb464-5500-49a1-8355-ffa68b6d0e60'} Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 could not be found. Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:43:36.467185 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 could not be found. Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 could not be found. Aug 08 00:43:36.469522 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:36.471139 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:36.471636 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Returning 404 to user: Instance 8d1fb464-5500-49a1-8355-ffa68b6d0e60 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:43:36.471745 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:36.471861 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ff133257-5bd3-4dcf-b69a-8de544a60526 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60" status: 404 len: 111 microversion: 2.1 time: 0.033374 Aug 08 00:43:36.471861 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 556/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:36 2022] GET /compute/v2.1/servers/8d1fb464-5500-49a1-8355-ffa68b6d0e60 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:43:36.473006 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:36.473719 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:36.474167 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:36.475012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:36.475505 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:36.475930 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:36.693976 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:36.701148 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f0206028-5d2d-4288-ad2a-d4429070cf97 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1546 microversion: 2.1 time: 0.240654 Aug 08 00:43:36.701864 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 550/1106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:36 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1546 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:36.731954 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d5a37ca2-0911-476f-b78e-fbfd568d7ad1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:36.731954 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d5a37ca2-0911-476f-b78e-fbfd568d7ad1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:36.732314 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d5a37ca2-0911-476f-b78e-fbfd568d7ad1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:36.732804 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d5a37ca2-0911-476f-b78e-fbfd568d7ad1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:36.733238 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d5a37ca2-0911-476f-b78e-fbfd568d7ad1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:36.733939 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d5a37ca2-0911-476f-b78e-fbfd568d7ad1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:36.734391 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d5a37ca2-0911-476f-b78e-fbfd568d7ad1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:36.734848 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d5a37ca2-0911-476f-b78e-fbfd568d7ad1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:36.817756 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d5a37ca2-0911-476f-b78e-fbfd568d7ad1 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097593 Aug 08 00:43:36.818648 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 557/1107] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Aug 8 00:43:36 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:37.799729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-6dfb51f0-b5b8-432f-bfab-2f3bd9759129 req-f5648c3f-a48a-4706-b4de-cc93573d31a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a72cc2-9190-43cd-9a38-5c40247f06fe", "tag": "886303e5-14f6-4125-ae5f-830989d01818"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:37.810475 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-6dfb51f0-b5b8-432f-bfab-2f3bd9759129 req-f5648c3f-a48a-4706-b4de-cc93573d31a4 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:37.810963 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-6dfb51f0-b5b8-432f-bfab-2f3bd9759129 req-f5648c3f-a48a-4706-b4de-cc93573d31a4 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:37.811434 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-6dfb51f0-b5b8-432f-bfab-2f3bd9759129 req-f5648c3f-a48a-4706-b4de-cc93573d31a4 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:37.822754 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-6dfb51f0-b5b8-432f-bfab-2f3bd9759129 req-f5648c3f-a48a-4706-b4de-cc93573d31a4 service nova] Creating event network-changed:886303e5-14f6-4125-ae5f-830989d01818 for instance b6a72cc2-9190-43cd-9a38-5c40247f06fe on hv-cinder-85164 Aug 08 00:43:37.827749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-6dfb51f0-b5b8-432f-bfab-2f3bd9759129 req-f5648c3f-a48a-4706-b4de-cc93573d31a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031636 Aug 08 00:43:37.829670 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 551/1108] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:39.830904 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:39.831437 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:39.838152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:39.838682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:39.839122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:39.839847 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:39.840298 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:39.840720 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:39.845381 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-e040b10c-0b62-480e-ad68-ffb8bdc9b23c req-812b595d-66f2-4877-802e-5632d187171f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89abab5-8e69-4485-be7a-d76eb57f16a5", "tag": "e6fc7acc-6a32-4ac7-91cb-f76468a453aa"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:39.861962 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-e040b10c-0b62-480e-ad68-ffb8bdc9b23c req-812b595d-66f2-4877-802e-5632d187171f service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:39.862560 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-e040b10c-0b62-480e-ad68-ffb8bdc9b23c req-812b595d-66f2-4877-802e-5632d187171f service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:39.863208 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-e040b10c-0b62-480e-ad68-ffb8bdc9b23c req-812b595d-66f2-4877-802e-5632d187171f service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:39.871892 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Going to try to terminate instance {{(pid=130173) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:43:39.886157 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-e040b10c-0b62-480e-ad68-ffb8bdc9b23c req-812b595d-66f2-4877-802e-5632d187171f service nova] Creating event network-changed:e6fc7acc-6a32-4ac7-91cb-f76468a453aa for instance b89abab5-8e69-4485-be7a-d76eb57f16a5 on hv-cinder-85164 Aug 08 00:43:39.891536 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-e040b10c-0b62-480e-ad68-ffb8bdc9b23c req-812b595d-66f2-4877-802e-5632d187171f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053207 Aug 08 00:43:39.892999 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 552/1109] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:39.905212 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=100 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:40.179850 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-827517a1-64a6-4afc-a31a-8a15425b6a33 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 204 len: 0 microversion: 2.1 time: 0.353152 Aug 08 00:43:40.181830 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 558/1110] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:43:39 2022] DELETE /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:43:40.190542 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:40.191260 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:40.197671 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:40.198399 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:40.199042 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:40.199760 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:40.200389 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:40.200817 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:40.342415 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:40.350158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-94888bcc-9616-443c-94f0-b36075e133e1 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1576 microversion: 2.1 time: 0.163760 Aug 08 00:43:40.350766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 553/1111] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:40 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:41.373297 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:41.374282 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:41.380730 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:41.381221 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:41.381656 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:41.382352 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:41.382814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:41.383832 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:41.522239 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:41.530467 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a2954095-4ae1-4459-85a5-ce11463c0f0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1576 microversion: 2.1 time: 0.161458 Aug 08 00:43:41.531036 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 559/1112] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:41 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:42.398480 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-de5f07b5-1108-43c2-8f2f-86f15d41d333 req-6841956d-fb99-483a-86d6-8b255f914ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89abab5-8e69-4485-be7a-d76eb57f16a5", "name": "network-vif-deleted", "tag": "e6fc7acc-6a32-4ac7-91cb-f76468a453aa"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:43:42.408823 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-de5f07b5-1108-43c2-8f2f-86f15d41d333 req-6841956d-fb99-483a-86d6-8b255f914ce9 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:42.409325 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-de5f07b5-1108-43c2-8f2f-86f15d41d333 req-6841956d-fb99-483a-86d6-8b255f914ce9 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:42.409746 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-de5f07b5-1108-43c2-8f2f-86f15d41d333 req-6841956d-fb99-483a-86d6-8b255f914ce9 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:42.422398 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-de5f07b5-1108-43c2-8f2f-86f15d41d333 req-6841956d-fb99-483a-86d6-8b255f914ce9 service nova] Creating event network-vif-deleted:e6fc7acc-6a32-4ac7-91cb-f76468a453aa for instance b89abab5-8e69-4485-be7a-d76eb57f16a5 on hv-cinder-85164 Aug 08 00:43:42.427177 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-de5f07b5-1108-43c2-8f2f-86f15d41d333 req-6841956d-fb99-483a-86d6-8b255f914ce9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032466 Aug 08 00:43:42.427840 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 554/1113] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:43:42.551067 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:42.551703 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:42.559005 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:42.559454 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:42.559891 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:42.560589 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:42.565429 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:42.565429 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:42.630656 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '322afd3893ac4c2ba4ab4d449f4d9159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22da44baa6b472e91d99fbcb03b583c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:43:42.639903 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-3f73b0bd-9b7f-4704-84e6-75d616aae4ce tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 200 len: 1224 microversion: 2.1 time: 0.091894 Aug 08 00:43:42.640503 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 560/1114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:42 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:43:43.662724 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:43.663475 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: b89abab5-8e69-4485-be7a-d76eb57f16a5] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:43.665469 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:43.670600 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:43.671090 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:43.671562 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:43.672580 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:43.672720 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:43.673246 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:43.675861 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG dbcounter [-] [130172] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:43.687993 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] HTTP exception thrown: Instance b89abab5-8e69-4485-be7a-d76eb57f16a5 could not be found. Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Request method failure captured: Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 HTTP/1.1 Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FpjFCxWg70FWQQl9rIKacZPbN4w7caocEk9_WTRmaUCRXlCvoib93fpml7Uz8ekZmx9G7YVI2yqQsUJ_eoc8qDz5SRP1OcUViRY6ryHH9_oL1fdgxgJljw5PvLIQYX4XaEZBe5xECurylkdI6SVPRj4HRZ9ACEEhoU2HWayHsQUIak Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:43:43.689873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 322afd3893ac4c2ba4ab4d449f4d9159 Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance b89abab5-8e69-4485-be7a-d76eb57f16a5 could not be found. Aug 08 00:43:43.691609 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'b89abab5-8e69-4485-be7a-d76eb57f16a5'} Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b89abab5-8e69-4485-be7a-d76eb57f16a5 could not be found. Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:43:43.696810 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b89abab5-8e69-4485-be7a-d76eb57f16a5 could not be found. Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b89abab5-8e69-4485-be7a-d76eb57f16a5 could not be found. Aug 08 00:43:43.698583 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:43.699994 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Returning 404 to user: Instance b89abab5-8e69-4485-be7a-d76eb57f16a5 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:43:43.699994 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b07814e1-443a-4b2d-8ede-1ff7509e3232 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5" status: 404 len: 111 microversion: 2.1 time: 0.033738 Aug 08 00:43:43.699994 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 555/1115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:43 2022] GET /compute/v2.1/servers/b89abab5-8e69-4485-be7a-d76eb57f16a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:43:44.189957 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:44.190480 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:44.192923 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:43:44.197749 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:44.198329 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:44.201324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:44.201324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:44.201324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:44.201324 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:44.214476 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] HTTP exception thrown: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Request method failure captured: Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: DELETE /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 HTTP/1.1 Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8FpjFCxWg70FWQQl9rIKacZPbN4w7caocEk9_WTRmaUCRXlCvoib93fpml7Uz8ekZmx9G7YVI2yqQsUJ_eoc8qDz5SRP1OcUViRY6ryHH9_oL1fdgxgJljw5PvLIQYX4XaEZBe5xECurylkdI6SVPRj4HRZ9ACEEhoU2HWayHsQUIak Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:43:44.216180 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 322afd3893ac4c2ba4ab4d449f4d9159 Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.217836 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': 'ed4b901e-ba2e-4eaa-bb78-47214419d1a0'} Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:43:44.218788 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.225193 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.227769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Returning 404 to user: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:43:44.227769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-ff2fcb02-d83b-47c6-a46e-6ae39594307a tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 404 len: 111 microversion: 2.1 time: 0.031572 Aug 08 00:43:44.227769 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 561/1116] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:43:44 2022] DELETE /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:43:44.228069 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:44.228069 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] [instance: ed4b901e-ba2e-4eaa-bb78-47214419d1a0] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:43:44.235330 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:44.235526 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:44.235960 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:44.236649 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:43:44.237142 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:43:44.237599 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:43:44.251528 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] HTTP exception thrown: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Request method failure captured: Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 HTTP/1.1 Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8FpjFCxWg70FWQQl9rIKacZPbN4w7caocEk9_WTRmaUCRXlCvoib93fpml7Uz8ekZmx9G7YVI2yqQsUJ_eoc8qDz5SRP1OcUViRY6ryHH9_oL1fdgxgJljw5PvLIQYX4XaEZBe5xECurylkdI6SVPRj4HRZ9ACEEhoU2HWayHsQUIak Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:43:44.253068 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a22da44baa6b472e91d99fbcb03b583c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: a22da44baa6b472e91d99fbcb03b583c Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-TestVolumeBootPattern-716752679 Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 322afd3893ac4c2ba4ab4d449f4d9159 Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-TestVolumeBootPattern-716752679-project Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.254880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'ed4b901e-ba2e-4eaa-bb78-47214419d1a0'} Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:43:44.255836 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. Aug 08 00:43:44.257425 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:43:44.258861 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Returning 404 to user: Instance ed4b901e-ba2e-4eaa-bb78-47214419d1a0 could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:43:44.258861 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-41deb9bc-0eb5-4a84-92f6-012506b80b23 tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0" status: 404 len: 111 microversion: 2.1 time: 0.031942 Aug 08 00:43:44.258861 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 556/1117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:43:44 2022] GET /compute/v2.1/servers/ed4b901e-ba2e-4eaa-bb78-47214419d1a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:43:45.771861 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-929a1e84-eed5-431b-a5b9-d5150e8f5b0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] Calling method '.version_select at 0x7fd1a20e3940>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:43:45.854849 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-929a1e84-eed5-431b-a5b9-d5150e8f5b0d tempest-TestVolumeBootPattern-716752679 tempest-TestVolumeBootPattern-716752679-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-57551070" status: 202 len: 0 microversion: 2.1 time: 0.087089 Aug 08 00:43:45.855481 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 562/1118] 10.222.0.15 () {58 vars in 1257 bytes} [Mon Aug 8 00:43:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-57551070 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:44:15.885794 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-2e19449a-aabd-44b4-84f3-bbf9a6e7d0ea tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:15.886399 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-2e19449a-aabd-44b4-84f3-bbf9a6e7d0ea tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:15.893676 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2e19449a-aabd-44b4-84f3-bbf9a6e7d0ea tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:15.894149 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2e19449a-aabd-44b4-84f3-bbf9a6e7d0ea tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:15.909590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2e19449a-aabd-44b4-84f3-bbf9a6e7d0ea tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:15.909590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2e19449a-aabd-44b4-84f3-bbf9a6e7d0ea tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:15.909590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2e19449a-aabd-44b4-84f3-bbf9a6e7d0ea tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:15.909590 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-2e19449a-aabd-44b4-84f3-bbf9a6e7d0ea tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:15.920250 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-2e19449a-aabd-44b4-84f3-bbf9a6e7d0ea tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/ips" status: 200 len: 145 microversion: 2.1 time: 0.039213 Aug 08 00:44:15.920817 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 557/1119] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Aug 8 00:44:15 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:44:17.437632 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:44:17.441834 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-c66fc81b-e38b-469a-9369-659620c44ea3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebe04d26-78d9-4102-bba2-60cc89449f23"}} {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:44:17.444122 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-c66fc81b-e38b-469a-9369-659620c44ea3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:17.451939 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c66fc81b-e38b-469a-9369-659620c44ea3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:17.452430 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c66fc81b-e38b-469a-9369-659620c44ea3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:17.452868 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c66fc81b-e38b-469a-9369-659620c44ea3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:17.453560 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c66fc81b-e38b-469a-9369-659620c44ea3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:17.454015 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c66fc81b-e38b-469a-9369-659620c44ea3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:17.454438 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-c66fc81b-e38b-469a-9369-659620c44ea3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:18.217035 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-c66fc81b-e38b-469a-9369-659620c44ea3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780452 Aug 08 00:44:18.217640 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 563/1120] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:44:17 2022] POST /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:44:18.445409 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:44:18.445944 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Mon Aug 8 00:44:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:44:25.728793 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-6c5bd05c-66a8-4dc3-a750-7352ffb8399d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:25.730924 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-6c5bd05c-66a8-4dc3-a750-7352ffb8399d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:25.737628 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6c5bd05c-66a8-4dc3-a750-7352ffb8399d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:25.738110 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6c5bd05c-66a8-4dc3-a750-7352ffb8399d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:25.738546 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6c5bd05c-66a8-4dc3-a750-7352ffb8399d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:25.739270 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6c5bd05c-66a8-4dc3-a750-7352ffb8399d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:25.739730 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6c5bd05c-66a8-4dc3-a750-7352ffb8399d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:25.740159 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-6c5bd05c-66a8-4dc3-a750-7352ffb8399d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:25.769241 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-6c5bd05c-66a8-4dc3-a750-7352ffb8399d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045818 Aug 08 00:44:25.769784 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 558/1121] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:44:25 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:44:25.781475 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-981c9801-b0c0-4173-89d1-6034f2e594ac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:25.782052 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-981c9801-b0c0-4173-89d1-6034f2e594ac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:25.788783 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-981c9801-b0c0-4173-89d1-6034f2e594ac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:25.789261 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-981c9801-b0c0-4173-89d1-6034f2e594ac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:25.789698 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-981c9801-b0c0-4173-89d1-6034f2e594ac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:25.790393 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-981c9801-b0c0-4173-89d1-6034f2e594ac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:25.790875 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-981c9801-b0c0-4173-89d1-6034f2e594ac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:25.791328 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-981c9801-b0c0-4173-89d1-6034f2e594ac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:25.819927 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-981c9801-b0c0-4173-89d1-6034f2e594ac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/ebe04d26-78d9-4102-bba2-60cc89449f23" status: 200 len: 194 microversion: 2.1 time: 0.043197 Aug 08 00:44:25.820505 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 564/1122] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Aug 8 00:44:25 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/ebe04d26-78d9-4102-bba2-60cc89449f23 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:44:27.332012 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-89dc51af-afdf-4f84-b735-7743efd0bbb0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbd7e4a5-fda5-42d6-afc8-b56f4ea42701"}} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:44:27.334302 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-89dc51af-afdf-4f84-b735-7743efd0bbb0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:27.341288 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-89dc51af-afdf-4f84-b735-7743efd0bbb0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:27.341766 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-89dc51af-afdf-4f84-b735-7743efd0bbb0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:27.342195 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-89dc51af-afdf-4f84-b735-7743efd0bbb0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:27.342880 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-89dc51af-afdf-4f84-b735-7743efd0bbb0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:27.343350 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-89dc51af-afdf-4f84-b735-7743efd0bbb0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:27.343771 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-89dc51af-afdf-4f84-b735-7743efd0bbb0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:28.039876 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-89dc51af-afdf-4f84-b735-7743efd0bbb0 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "POST /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711586 Aug 08 00:44:28.040490 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 559/1123] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Aug 8 00:44:27 2022] POST /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:44:35.561869 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-04f38573-a081-45b1-b19a-2e1b415d4feb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:35.564165 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-04f38573-a081-45b1-b19a-2e1b415d4feb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:35.571152 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04f38573-a081-45b1-b19a-2e1b415d4feb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:35.571664 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04f38573-a081-45b1-b19a-2e1b415d4feb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:35.572101 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04f38573-a081-45b1-b19a-2e1b415d4feb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:35.572793 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04f38573-a081-45b1-b19a-2e1b415d4feb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:35.573245 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04f38573-a081-45b1-b19a-2e1b415d4feb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:35.573669 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-04f38573-a081-45b1-b19a-2e1b415d4feb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:35.603981 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-04f38573-a081-45b1-b19a-2e1b415d4feb tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045995 Aug 08 00:44:35.604529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 565/1124] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:44:35 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 08 00:44:35.765700 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-f1c83db4-9427-45b2-9777-f10bbc910839 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:35.766248 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-f1c83db4-9427-45b2-9777-f10bbc910839 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:35.772490 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1c83db4-9427-45b2-9777-f10bbc910839 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:35.772968 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1c83db4-9427-45b2-9777-f10bbc910839 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:35.773400 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1c83db4-9427-45b2-9777-f10bbc910839 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:35.774087 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1c83db4-9427-45b2-9777-f10bbc910839 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:35.774536 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1c83db4-9427-45b2-9777-f10bbc910839 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:35.774956 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-f1c83db4-9427-45b2-9777-f10bbc910839 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:35.803070 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-f1c83db4-9427-45b2-9777-f10bbc910839 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/ebe04d26-78d9-4102-bba2-60cc89449f23" status: 200 len: 194 microversion: 2.1 time: 0.042338 Aug 08 00:44:35.803674 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 560/1125] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Aug 8 00:44:35 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/ebe04d26-78d9-4102-bba2-60cc89449f23 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:44:35.814304 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:35.814791 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:35.821316 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:35.821786 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:35.822216 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:35.822901 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:35.823389 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:35.823810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:36.076039 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lazy-loading 'services' on Instance uuid b6a72cc2-9190-43cd-9a38-5c40247f06fe {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:44:36.328793 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-dd266c80-db37-4439-bb23-09db85e20dac tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/ebe04d26-78d9-4102-bba2-60cc89449f23" status: 202 len: 0 microversion: 2.1 time: 0.518119 Aug 08 00:44:36.329292 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 566/1126] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:44:35 2022] DELETE /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/ebe04d26-78d9-4102-bba2-60cc89449f23 => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:44:38.512350 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-b34fcc5a-ec88-43d7-b9f0-21474535a3fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:38.512864 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-b34fcc5a-ec88-43d7-b9f0-21474535a3fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:38.519330 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b34fcc5a-ec88-43d7-b9f0-21474535a3fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:38.519808 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b34fcc5a-ec88-43d7-b9f0-21474535a3fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:38.520240 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b34fcc5a-ec88-43d7-b9f0-21474535a3fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:38.520928 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b34fcc5a-ec88-43d7-b9f0-21474535a3fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:38.521381 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b34fcc5a-ec88-43d7-b9f0-21474535a3fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:38.521804 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-b34fcc5a-ec88-43d7-b9f0-21474535a3fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:38.549964 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-b34fcc5a-ec88-43d7-b9f0-21474535a3fd tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/cbd7e4a5-fda5-42d6-afc8-b56f4ea42701" status: 200 len: 194 microversion: 2.1 time: 0.041492 Aug 08 00:44:38.550536 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 561/1127] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Aug 8 00:44:38 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/cbd7e4a5-fda5-42d6-afc8-b56f4ea42701 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:44:38.562659 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:38.563256 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:38.569335 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:38.569810 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:38.570320 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:38.571084 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:38.571561 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:38.571986 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:38.650042 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lazy-loading 'services' on Instance uuid b6a72cc2-9190-43cd-9a38-5c40247f06fe {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:44:38.925322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-4e47201f-d11d-483d-b448-85dd12160a6b tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/cbd7e4a5-fda5-42d6-afc8-b56f4ea42701" status: 202 len: 0 microversion: 2.1 time: 0.367034 Aug 08 00:44:38.925885 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 567/1128] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Aug 8 00:44:38 2022] DELETE /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments/cbd7e4a5-fda5-42d6-afc8-b56f4ea42701 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:44:40.094535 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-64e2f197-d3f7-4073-ad64-403e67e0eeba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:40.096745 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-64e2f197-d3f7-4073-ad64-403e67e0eeba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:40.103158 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64e2f197-d3f7-4073-ad64-403e67e0eeba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:40.103673 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64e2f197-d3f7-4073-ad64-403e67e0eeba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:40.104107 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64e2f197-d3f7-4073-ad64-403e67e0eeba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:40.104798 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64e2f197-d3f7-4073-ad64-403e67e0eeba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:40.105252 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64e2f197-d3f7-4073-ad64-403e67e0eeba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:40.105678 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-64e2f197-d3f7-4073-ad64-403e67e0eeba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:40.133759 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-64e2f197-d3f7-4073-ad64-403e67e0eeba tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043249 Aug 08 00:44:40.134306 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 562/1129] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:44:40 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 00:44:40.246520 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-5f75445b-31f4-4f66-9d8f-809a12689d46 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:40.251363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-5f75445b-31f4-4f66-9d8f-809a12689d46 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:40.255686 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5f75445b-31f4-4f66-9d8f-809a12689d46 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:40.256164 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5f75445b-31f4-4f66-9d8f-809a12689d46 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:40.256604 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5f75445b-31f4-4f66-9d8f-809a12689d46 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:40.257305 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5f75445b-31f4-4f66-9d8f-809a12689d46 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:40.258327 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5f75445b-31f4-4f66-9d8f-809a12689d46 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:40.258904 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-5f75445b-31f4-4f66-9d8f-809a12689d46 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:40.287097 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-5f75445b-31f4-4f66-9d8f-809a12689d46 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045372 Aug 08 00:44:40.287680 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 568/1130] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Aug 8 00:44:40 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 08 00:44:40.347983 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:40.348470 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:40.354390 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:40.354864 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:40.355326 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:40.356011 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:40.356456 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:40.356873 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:40.381346 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Going to try to terminate instance {{(pid=130172) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 08 00:44:40.692156 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-8117cf98-e9ef-4e65-843b-aa75fb4982b7 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 204 len: 0 microversion: 2.1 time: 0.347650 Aug 08 00:44:40.692767 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 563/1131] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:44:40 2022] DELETE /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 08 00:44:40.701099 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:40.701706 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:40.707620 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:40.708095 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:40.708529 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:40.709212 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:40.709661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:40.710094 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:40.842210 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:44:40.849773 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-d6794d6d-058a-4bd1-bc50-976de9229867 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1671 microversion: 2.1 time: 0.152661 Aug 08 00:44:40.850345 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 569/1132] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:44:40 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:44:41.873128 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:41.873817 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:41.880140 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:41.880620 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:41.881051 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:41.881729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:41.882173 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:41.882636 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:42.015453 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.policy [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130172) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:44:42.022948 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-7edc5752-94dc-4b04-a5bd-c3b041a31d7d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1671 microversion: 2.1 time: 0.154140 Aug 08 00:44:42.023741 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 564/1133] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:44:41 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:44:43.043829 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:43.044363 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:43.050813 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:43.051345 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:43.051765 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:43.052451 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:43.052902 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:43.053322 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:43.182962 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:44:43.190661 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-99b79002-691b-47e4-97a1-405044d6f331 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1671 microversion: 2.1 time: 0.150794 Aug 08 00:44:43.191772 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 570/1134] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:44:43 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:44:43.910472 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [req-a5b19a88-e07d-480c-98c4-b7b079b6d912 req-0df26dca-afbb-4d3c-9d0d-7ed0f2e501e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a72cc2-9190-43cd-9a38-5c40247f06fe", "name": "network-vif-deleted", "tag": "886303e5-14f6-4125-ae5f-830989d01818"}]} {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 08 00:44:43.921749 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-a5b19a88-e07d-480c-98c4-b7b079b6d912 req-0df26dca-afbb-4d3c-9d0d-7ed0f2e501e1 service nova] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:43.922226 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-a5b19a88-e07d-480c-98c4-b7b079b6d912 req-0df26dca-afbb-4d3c-9d0d-7ed0f2e501e1 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:43.922656 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [req-a5b19a88-e07d-480c-98c4-b7b079b6d912 req-0df26dca-afbb-4d3c-9d0d-7ed0f2e501e1 service nova] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:43.935248 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.compute.server_external_events [req-a5b19a88-e07d-480c-98c4-b7b079b6d912 req-0df26dca-afbb-4d3c-9d0d-7ed0f2e501e1 service nova] Creating event network-vif-deleted:886303e5-14f6-4125-ae5f-830989d01818 for instance b6a72cc2-9190-43cd-9a38-5c40247f06fe on hv-cinder-85164 Aug 08 00:44:43.940397 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [req-a5b19a88-e07d-480c-98c4-b7b079b6d912 req-0df26dca-afbb-4d3c-9d0d-7ed0f2e501e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033707 Aug 08 00:44:43.941025 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 565/1135] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Aug 8 00:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 08 00:44:44.211917 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:44.212567 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:44.219103 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:44.219691 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:44.220132 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:44.221029 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:44.221518 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:44.221950 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:44.255748 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:44.256232 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:44.256671 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:44.257121 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.objects.instance [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lazy-loading 'fault' on Instance uuid b6a72cc2-9190-43cd-9a38-5c40247f06fe {{(pid=130173) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 08 00:44:44.301426 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.policy [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f22b554ae524ccf9a8777ac24cdd688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c27d244bd514766b955d1a4aba239eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130173) authorize /opt/stack/nova/nova/policy.py:199}} Aug 08 00:44:44.309653 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-53667fe5-1197-4437-a367-27246997462d tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 200 len: 1326 microversion: 2.1 time: 0.102153 Aug 08 00:44:44.310215 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 571/1136] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:44:44 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 08 00:44:45.332111 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:45.332707 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:45.339798 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:45.340271 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:45.340698 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:45.341381 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:45.341827 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:45.342243 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:45.356146 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] HTTP exception thrown: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Request method failure captured: Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe HTTP/1.1 Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Ftzna2_8x5nrcKUtrH5FhUTIg-8ZHL7q6qUuijFoK6VYwHLpVba8t1u8RCPPyChTXN33nL5JiJTZG83WHHuueMwMDAeIm1MBV7ZMlYdhfI8QuZrRMEFQ4DF5-SkdKeD_G5gMA5lGj5DNyo7NCH7zenvvcxjYjxtHzgujvb7P_bSJCM Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:44:45.357729 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 1f22b554ae524ccf9a8777ac24cdd688 Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:45.359553 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'b6a72cc2-9190-43cd-9a38-5c40247f06fe'} Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:44:45.360545 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:45.362239 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:45.363939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Returning 404 to user: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:44:45.363939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-533b4383-522a-4ec8-bc8d-bc1aa6d0fd64 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 404 len: 111 microversion: 2.1 time: 0.031341 Aug 08 00:44:45.363939 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 566/1137] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:44:45 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:44:45.368623 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-7dfb67a3-9e1b-4531-aacb-3cc338fad58c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '.version_select at 0x7fd1a20d1790>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:45.465553 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-7dfb67a3-9e1b-4531-aacb-3cc338fad58c tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-197173968" status: 202 len: 0 microversion: 2.1 time: 0.101388 Aug 08 00:44:45.466138 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 572/1138] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Aug 8 00:44:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-197173968 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 08 00:44:48.869694 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:48.870181 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:48.876757 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:48.877224 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:48.877654 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:48.878334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:48.878777 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:48.879193 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:48.892377 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] HTTP exception thrown: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Request method failure captured: Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe HTTP/1.1 Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Ftzna2_8x5nrcKUtrH5FhUTIg-8ZHL7q6qUuijFoK6VYwHLpVba8t1u8RCPPyChTXN33nL5JiJTZG83WHHuueMwMDAeIm1MBV7ZMlYdhfI8QuZrRMEFQ4DF5-SkdKeD_G5gMA5lGj5DNyo7NCH7zenvvcxjYjxtHzgujvb7P_bSJCM Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:44:48.893920 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 1f22b554ae524ccf9a8777ac24cdd688 Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.895778 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': 'b6a72cc2-9190-43cd-9a38-5c40247f06fe'} Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:44:48.896786 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.898527 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.900444 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Returning 404 to user: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:44:48.900444 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-00ff7f30-4d8b-49f8-869f-da44cf47863f tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 404 len: 111 microversion: 2.1 time: 0.030208 Aug 08 00:44:48.900444 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 567/1139] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:44:48 2022] DELETE /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:44:48.904452 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:48.905059 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: b6a72cc2-9190-43cd-9a38-5c40247f06fe] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:48.906956 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=2 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:44:48.912221 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:48.912693 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:48.913129 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:48.913809 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:48.914753 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:48.915170 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:48.918226 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG dbcounter [-] [130173] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 00:44:48.928615 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] HTTP exception thrown: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Request method failure captured: Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe HTTP/1.1 Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Ftzna2_8x5nrcKUtrH5FhUTIg-8ZHL7q6qUuijFoK6VYwHLpVba8t1u8RCPPyChTXN33nL5JiJTZG83WHHuueMwMDAeIm1MBV7ZMlYdhfI8QuZrRMEFQ4DF5-SkdKeD_G5gMA5lGj5DNyo7NCH7zenvvcxjYjxtHzgujvb7P_bSJCM Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:44:48.930856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 1f22b554ae524ccf9a8777ac24cdd688 Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.932711 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': 'b6a72cc2-9190-43cd-9a38-5c40247f06fe'} Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:44:48.933762 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. Aug 08 00:44:48.935349 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:48.937054 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Returning 404 to user: Instance b6a72cc2-9190-43cd-9a38-5c40247f06fe could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:44:48.937054 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-a955636c-1041-4f69-9314-a8c6f3e7ec69 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe" status: 404 len: 111 microversion: 2.1 time: 0.032208 Aug 08 00:44:48.937054 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 573/1140] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:44:48 2022] GET /compute/v2.1/servers/b6a72cc2-9190-43cd-9a38-5c40247f06fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 08 00:44:50.182451 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:50.182942 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.compute.api [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130172) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:50.189380 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:50.189860 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:50.190298 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:50.190996 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:50.191491 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:50.191918 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG oslo_concurrency.lockutils [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:50.205830 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.wsgi [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] HTTP exception thrown: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Request method failure captured: Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: request: DELETE /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c HTTP/1.1 Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept: application/json Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Accept-Encoding: identity Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Connection: close Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Length: 0 Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Content-Type: application/json Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Host: 10.222.0.15 Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Openstack-System-Scope: None Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: User-Agent: python-urllib3/1.26.11 Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Auth-Token: gAAAAABi8Ftzna2_8x5nrcKUtrH5FhUTIg-8ZHL7q6qUuijFoK6VYwHLpVba8t1u8RCPPyChTXN33nL5JiJTZG83WHHuueMwMDAeIm1MBV7ZMlYdhfI8QuZrRMEFQ4DF5-SkdKeD_G5gMA5lGj5DNyo7NCH7zenvvcxjYjxtHzgujvb7P_bSJCM Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Id: None Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Domain-Name: None Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Identity-Status: Confirmed Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Is-Admin-Project: True Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Id: default Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Domain-Name: Default Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Project-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Role: reader,member Aug 08 00:44:50.207384 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Roles: reader,member Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Id: default Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Domain-Name: Default Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Id: 1f22b554ae524ccf9a8777ac24cdd688 Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: X-User-Name: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: method: > Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: exception: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.209184 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: action_args: {'id': '62011870-5958-4d03-9ab1-9edb56112d1c'} Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: {{(pid=130172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:44:50.210028 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.211498 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.213197 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: DEBUG nova.api.openstack.wsgi [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Returning 404 to user: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. {{(pid=130172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:44:50.213197 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO nova.api.openstack.requestlog [None req-adbc89a0-38b8-4a74-95e0-d12bae2874a4 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "DELETE /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 404 len: 111 microversion: 2.1 time: 0.030965 Aug 08 00:44:50.213197 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: [pid: 130172|app: 0|req: 568/1141] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Aug 8 00:44:50 2022] DELETE /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:44:50.218056 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Calling method '>' {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 08 00:44:50.218678 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.compute.api [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] [instance: 62011870-5958-4d03-9ab1-9edb56112d1c] Fetching instance by UUID {{(pid=130173) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 08 00:44:50.225837 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:50.226313 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:50.226753 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:50.227468 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Acquiring lock "bcec479f-7399-421c-8451-79722ed0a20d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 08 00:44:50.227922 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 08 00:44:50.228348 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG oslo_concurrency.lockutils [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Lock "bcec479f-7399-421c-8451-79722ed0a20d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 08 00:44:50.241645 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.wsgi [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] HTTP exception thrown: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Request method failure captured: Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: request: GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c HTTP/1.1 Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept: application/json Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Accept-Encoding: identity Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Connection: close Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Length: 0 Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Content-Type: application/json Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Host: 10.222.0.15 Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Openstack-System-Scope: None Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: User-Agent: python-urllib3/1.26.11 Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Auth-Token: gAAAAABi8Ftzna2_8x5nrcKUtrH5FhUTIg-8ZHL7q6qUuijFoK6VYwHLpVba8t1u8RCPPyChTXN33nL5JiJTZG83WHHuueMwMDAeIm1MBV7ZMlYdhfI8QuZrRMEFQ4DF5-SkdKeD_G5gMA5lGj5DNyo7NCH7zenvvcxjYjxtHzgujvb7P_bSJCM Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Id: None Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Domain-Name: None Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Identity-Status: Confirmed Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Is-Admin-Project: True Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Id: default Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Domain-Name: Default Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Project-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Role: reader,member Aug 08 00:44:50.243814 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Roles: reader,member Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2c27d244bd514766b955d1a4aba239eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Id: 2c27d244bd514766b955d1a4aba239eb Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131478723 Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Id: default Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Domain-Name: Default Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Id: 1f22b554ae524ccf9a8777ac24cdd688 Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: X-User-Name: tempest-AttachVolumeTestJSON-131478723-project Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: method: > Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: exception: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.245658 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: action_args: {'id': '62011870-5958-4d03-9ab1-9edb56112d1c'} Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: {{(pid=130173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 08 00:44:50.246682 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. Aug 08 00:44:50.248286 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: ERROR nova.api.openstack.wsgi Aug 08 00:44:50.249856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: DEBUG nova.api.openstack.wsgi [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] Returning 404 to user: Instance 62011870-5958-4d03-9ab1-9edb56112d1c could not be found. {{(pid=130173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 08 00:44:50.249856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO nova.api.openstack.requestlog [None req-42cafee7-5840-4f1a-a6e3-6ccc0e99d7e3 tempest-AttachVolumeTestJSON-131478723 tempest-AttachVolumeTestJSON-131478723-project] 10.222.0.15 "GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c" status: 404 len: 111 microversion: 2.1 time: 0.031552 Aug 08 00:44:50.249856 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: [pid: 130173|app: 0|req: 574/1142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Aug 8 00:44:50 2022] GET /compute/v2.1/servers/62011870-5958-4d03-9ab1-9edb56112d1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 08 00:45:52.046573 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:45:52.047218 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Mon Aug 8 00:45:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:45:59.957233 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:45:59.957843 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Mon Aug 8 00:45:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:47:27.041081 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:47:27.041688 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Mon Aug 8 00:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:47:38.453630 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:47:38.454221 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Mon Aug 8 00:47:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:47:51.636171 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:47:51.636760 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Mon Aug 8 00:47:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:47:51.734791 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:47:51.735287 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Mon Aug 8 00:47:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:49:12.054905 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:49:12.055485 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Mon Aug 8 00:49:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:49:19.966250 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:49:19.966831 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Mon Aug 8 00:49:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:50:47.049498 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:50:47.050182 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Mon Aug 8 00:50:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:50:58.461334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:50:58.461970 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Mon Aug 8 00:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:51:11.644364 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:51:11.644798 dv-cinder-851640-3-iscsi devstack@n-api.service[130173]: Mon Aug 8 00:51:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 08 00:51:11.742828 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 08 00:51:11.743334 dv-cinder-851640-3-iscsi devstack@n-api.service[130172]: Mon Aug 8 00:51:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!